45740 2010-09-14 04:01:39 -0700 SheriffBot should announce when the commit-queue hits a flaky test 2010-12-10 17:36:31 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) PC OS X 10.5 RESOLVED DUPLICATE 50803 P2 Normal --- 1 eric webkit-unassigned abarth dglazkov dpranke ojan victorw oldest_to_newest 278803 0 eric 2010-09-14 04:01:39 -0700 SheriffBot should announce when the commit-queue hits a flaky test Flaky tests should be as annoying for the channel as they are for folks trying to use the commit-queue. We also really just need the flakey test dashboard. 278832 1 ojan 2010-09-14 05:11:54 -0700 How do you distinguish the commit queue hitting a flaky test versus a test that actually fails due to the patch it's trying to commit? As far as the flakiness dashboard, getting it hooked up is just a matter of finally switching over to new-run-webkit-tests. Alternately, making the JSON generation code work standalone (shouldn't be too hard) and having old-run-webkit-tests call out to it. 278883 2 dglazkov 2010-09-14 07:35:14 -0700 (In reply to comment #1) > How do you distinguish the commit queue hitting a flaky test versus a test that actually fails due to the patch it's trying to commit? > > As far as the flakiness dashboard, getting it hooked up is just a matter of finally switching over to new-run-webkit-tests. Alternately, making the JSON generation code work standalone (shouldn't be too hard) and having old-run-webkit-tests call out to it. +1 to switching to NWRT. 320514 3 eric 2010-12-10 17:36:31 -0800 I think this is better covered by bug 50803. *** This bug has been marked as a duplicate of bug 50803 ***