Right now there are two directories with content extension tests, which causes them to be run with two WebKitTestRunners at the same time, and sometimes they delete each other's content extension when resetting the state between tests. I'm pretty sure this is what is causing flakiness like http://webkit-test-results.appspot.com/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcontentextensions&revision=185388
Created attachment 254675 [details]
Comment on attachment 254675 [details]
This is ok as a short term fix, however the requirement to have all these tests in one directory is not something that we should remember forever, and also we should have tests work with -f.
How can we make parallel testing processes independent?
The problem is related to the call to _removeAllContentExtensions in TestControllerMac.mm but I'm not sure how to safely make it work with different directories. And I'm only about 90% sure this moving-all-tests-to-the-same-directory will work.