Bug 16872

Summary: Need the ability to replay a randomized list of tests
Product: WebKit Reporter: David Kilzer (:ddkilzer) <ddkilzer>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Enhancement CC: ap, bburg
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: All   
OS: All   
Bug Depends on: 16869    
Bug Blocks: 16873    

Description David Kilzer (:ddkilzer) 2008-01-14 10:16:02 PST
Once the fix for Bug 16869 lands, we need a way to record and reply a randomized list of tests easily.  The simplest way would be to write out a file with the list of tests, then add a mechanism to run-webkit-tests to use that file for its test order (unless it already does that).
Comment 1 BJ Burg 2015-09-08 11:04:38 PDT
The replay-part should be mostly handled by 

Tools/Scripts/run-webkit-tests --test-file=FILE

Although it might re-segment the tests in some arbitrary way unless you specify --run-singly. I think for purposes of automatically bisecting, you would want run-webkit-tests to dump a per-worker list of executed tests.