Some of the new perf tests seem to be flaky. I'll skip them on non-chromium platforms and mark them as PASS TEXT for chromium. That way, we can get flakiness data and make them non-flaky without turning bots red in in interim.
Created attachment 65331 [details] Patch
Comment on attachment 65331 [details] Patch Ok for testing flakiness. If it works, we'll need to do this properly with layoutTestController, otherwise we can just revert this patch.
Committed r65940: <http://trac.webkit.org/changeset/65940>
Any updates on this?
It did not fix the problem. I don't remember if it improved things though. Some of the tests are not flaky at all, but some of them are super flaky. See http://test-results.appspot.com/dashboards/flakiness_dashboard.html#master=ChromiumWebkit&tests=%5Eperf for the results of the flaky tests on the chromium bots. The ones that are not flaky don't show up there. Also, some of the ones listed there look like they crashed when all the tests in that run crashed (i.e. are not flaky). It's been vaguely on my TODO list to try and understand the cause of the flakiness, but I haven't gotten around to it.
I suppose we could take the non-flaky ones off the Skipped lists.