Bug 86014 - Chromium perf bots fail to download the binary ~50% of the time
Summary: Chromium perf bots fail to download the binary ~50% of the time
Status: RESOLVED LATER
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks: 77037
  Show dependency tree / graph
 
Reported: 2012-05-09 13:56 PDT by Ojan Vafai
Modified: 2012-09-20 20:08 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ojan Vafai 2012-05-09 13:56:55 PDT 
This means we're losing a lot of coverage. Not sure who manages these bots...

http://build.webkit.org/waterfall?show=Chromium%20Win%20Release%20(Perf)&show=Chromium%20Mac%20Release%20(Perf)&show=Chromium%20Linux%20Release%20(Perf)
Comment 1 Ryosuke Niwa 2012-05-09 14:45:57 PDT 
This is because perf bots' cycle time is significantly longer than that of builders especially when changes are trivial. perf. bots get behind, and hits master's threshold to delete uploaded binaries. I've asked wms to increase the threadshold but it didn't help. The only thing it did was increasing the delay and backlogs.

The only solution to this problem is reducing cycle time of perf bots. Otherwise, the backlog will grow indefinitely.
Comment 2 Tony Chang 2012-05-09 14:47:10 PDT 
Do we know which tests are the slowest?  Maybe we can get a better cycle time just by fixing a dozen or so tests.
Comment 3 Ryosuke Niwa 2012-05-09 14:52:18 PDT 
Yeah, most of them are Dromaeo tests. We spend roughly 30% of time running the slowest 5 tests. You can process the stdout on bots to find the ranking although I've posted somewhere on Bugzilla as well.
Comment 4 Ryosuke Niwa 2012-07-19 15:43:24 PDT 
We don't have any workable solution for this at the moment.