Bug 80776

Summary: [PerformanceTests] Consider tracking Dromaeo composites in addition to or instead of individual tests
Product: WebKit Reporter: Maciej Stachowiak <mjs>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW    
Severity: Normal CC: morrita, rniwa
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: Unspecified   
OS: Unspecified   
Bug Depends on:    
Bug Blocks: 76156    

Maciej Stachowiak
Reported 2012-03-10 20:28:01 PST
Individual Dromaeo tests can show quite a bit of random variance, but the composite score form the JS+DOM tests is pretty stable from run to run. However, it is sensitive enough to individual test changes that it will catch a real regression. So tracking it probably optimizes better for catching real regressions but not false positives.
Attachments
Note You need to log in before you can comment on or make changes to this bug.