Bug 207504 - [ews] Display flaky layout test names in build summary
Summary: [ews] Display flaky layout test names in build summary
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Aakash Jain
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-10 13:40 PST by Aakash Jain
Modified: 2020-04-29 03:12 PDT (History)
4 users (show)

See Also:


Attachments
Patch (4.86 KB, patch)
2020-02-10 13:47 PST, Aakash Jain
jbedard: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Aakash Jain 2020-02-10 13:40:10 PST
When WebKitTest (layout-tests) fail, we re-run them. If some tests fail in re-run as well, we run the tests on clean tree. If there are pre-existing test failures, the build summary is set to something like: 'Found 1 pre-existing test failure: test1.' 

It would be better to include the flaky test name as well in the build summary, if there were any flaky failures. e.g.: 'Found 1 pre-existing test failure: test1, Found flaky tests: test2, test3'.
This would help bot-watchers easily notice flaky tests (and the pattern).
Comment 1 Aakash Jain 2020-02-10 13:47:05 PST
Created attachment 390289 [details]
Patch
Comment 3 Aakash Jain 2020-02-10 14:09:01 PST
Committed r256212: <https://trac.webkit.org/changeset/256212>
Comment 4 Radar WebKit Bug Importer 2020-02-10 14:09:15 PST
<rdar://problem/59324970>