Bug 70544

Summary: Tools should more eagerly contact people who may have broken the build
Product: WebKit Reporter: Simon Fraser (smfr) <simon.fraser>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: abarth, dpranke, eric, jchaffraix, simon.fraser, tomz
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: Unspecified   
OS: Unspecified   
Bug Depends on:    
Bug Blocks: 36581    

Description Simon Fraser (smfr) 2011-10-20 13:58:36 PDT
When you check in something that breaks the build (compile failure, test failure), we should more proactively contact people who are on the hook for the bustage. This should include:
* sheriffbot pinging them on IRC (this used to happen)
* adding comments to bugs
* sending email
* sending text message to phone numbers
Comment 1 Adam Barth 2011-10-20 14:00:15 PDT
We have all the code to do this, but it's current disabled because it was too spammy.  Maybe restricting it to compile failures would be a good way to make it non-spammy?
Comment 2 Simon Fraser (smfr) 2011-10-20 14:07:02 PDT
We have so much unnoticed build and test bustage that I'd rather it be too spammy. It should only spam those who've committed, which should make people more cautious before committing. That can only be a good thing.
Comment 3 Adam Barth 2011-10-20 14:12:36 PDT
The first step is (roughly) to revert http://trac.webkit.org/changeset/90636
Comment 4 Eric Seidel (no email) 2011-10-20 15:00:24 PDT
I support this.  Our last (long running) attempt at this seemed a failure.  I think what you're seeking is cultural change more than technical change.  Perhaps the technical can help the cultural with the right leadership.
Comment 5 Adam Barth 2011-10-20 15:17:17 PDT
Some ideas for reducing spam:

1) Instead of using Pass Fail Fail as the signal to bug people, we can use Pass Pass Fail Fail.  That will filter out noise from tests that fail 90% of the time.

2) Rate limit messages from each test.  If we've bugged someone about a given test already in the past 24 hours, don't bug anyone this time.
Comment 6 Julien Chaffraix 2011-10-24 13:58:53 PDT
It's sad that the tree is more or less always half red / orange these days (and that's only the core builders). Currently if you want to make sure your patches don't break anything, you have first to get whoever broke the build to fix it first.
Having sheriffbot yell at people had the upside of making it obvious that the person was contacted about it and when he/she heard about the breakage (in case a rollout needs to be done).
Comment 7 Adam Barth 2011-10-24 14:01:38 PDT
There are also too many builders in the core category.  If a port hasn't even compiled in days, it should be removed.
Comment 8 Eric Seidel (no email) 2011-11-08 19:45:29 PST
We've also discussed making the sheriff-bot more agressive about contacting people who break the build in the past.  See bug 36581.