RESOLVED DUPLICATE of bug 50803 45740
SheriffBot should announce when the commit-queue hits a flaky test 
https://bugs.webkit.org/show_bug.cgi?id=45740
Summary SheriffBot should announce when the commit-queue hits a flaky test
Eric Seidel (no email)
Reported 2010-09-14 04:01:39 PDT
SheriffBot should announce when the commit-queue hits a flaky test Flaky tests should be as annoying for the channel as they are for folks trying to use the commit-queue. We also really just need the flakey test dashboard.
Attachments
Add attachment proposed patch, testcase, etc.
Ojan Vafai
Comment 1 2010-09-14 05:11:54 PDT
How do you distinguish the commit queue hitting a flaky test versus a test that actually fails due to the patch it's trying to commit? As far as the flakiness dashboard, getting it hooked up is just a matter of finally switching over to new-run-webkit-tests. Alternately, making the JSON generation code work standalone (shouldn't be too hard) and having old-run-webkit-tests call out to it.
Dimitri Glazkov (Google)
Comment 2 2010-09-14 07:35:14 PDT
(In reply to comment #1) > How do you distinguish the commit queue hitting a flaky test versus a test that actually fails due to the patch it's trying to commit? > > As far as the flakiness dashboard, getting it hooked up is just a matter of finally switching over to new-run-webkit-tests. Alternately, making the JSON generation code work standalone (shouldn't be too hard) and having old-run-webkit-tests call out to it. +1 to switching to NWRT.
Eric Seidel (no email)
Comment 3 2010-12-10 17:36:31 PST
I think this is better covered by bug 50803. *** This bug has been marked as a duplicate of bug 50803 ***
Note You need to log in before you can comment on or make changes to this bug.