Please note: This schedule is for OpenStack Active Technical Contributors participating in the Icehouse Design Summit sessions in Hong Kong. These are working sessions to determine the roadmap of the Icehouse release and make decisions across the project. To see the full OpenStack Summit schedule, including presentations, panels and workshops, go to http://openstacksummitnovember2013.sched.org.
The week before feature freeze in havanna we switched tempest over from running tests serially to run all of its tests in parallel using testr. This greatly improved runtime and made tempest finish executing in about the same amount of time as the py26 unit tests for some of the other projects(20-30mins). Additionally, this helps shake loose more bugs in the projects by making multiple requests at once which more closely simulates an actual workload. However, moving to parallel execution came at the cost of changing how tests interact with each other and an increased risk of nondeterministic failures in the gate.
So moving into icehouse I think it's important that we discuss what additional changes need to be made to further improve parallel stability and if there are any other optimizations that we can make to improve tempest performance. Also, it will be a good forum to discuss things to watch out for when adding tests to tempest and possibly adding automated checks to catch common parallel execution issues before we merge them.
