Bug 207504

Summary: [ews] Display flaky layout test names in build summary
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, jbedard, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=207050
https://bugs.webkit.org/show_bug.cgi?id=210855
Attachments:
Description Flags
Patch jbedard: review+

Description Aakash Jain 2020-02-10 13:40:10 PST 
When WebKitTest (layout-tests) fail, we re-run them. If some tests fail in re-run as well, we run the tests on clean tree. If there are pre-existing test failures, the build summary is set to something like: 'Found 1 pre-existing test failure: test1.' 

It would be better to include the flaky test name as well in the build summary, if there were any flaky failures. e.g.: 'Found 1 pre-existing test failure: test1, Found flaky tests: test2, test3'.
This would help bot-watchers easily notice flaky tests (and the pattern).
Comment 1 Aakash Jain 2020-02-10 13:47:05 PST 
Created attachment 390289 [details]
Patch
Comment 3 Aakash Jain 2020-02-10 14:09:01 PST 
Committed r256212: <https://trac.webkit.org/changeset/256212>
Comment 4 Radar WebKit Bug Importer 2020-02-10 14:09:15 PST 
<rdar://problem/59324970>