Bug 199194 - [ews-build] Retry Layout test in case of failures
Summary: [ews-build] Retry Layout test in case of failures
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Aakash Jain
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-06-25 10:58 PDT by Aakash Jain
Modified: 2019-06-26 16:23 PDT (History)
5 users (show)

See Also:

Attachments
Patch (2.83 KB, patch)
2019-06-25 11:07 PDT, Aakash Jain 		no flags Details | Formatted Diff | Diff
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Aakash Jain 2019-06-25 10:58:10 PDT 
When failures are found in layout-tests, we should retry the tests to ensure that the failures are not because of flaky test. Further, we should run the layout-tests without the patch as well, to identify whether the failures are pre-existing or new failures introduced by the patch.
Comment 1 Aakash Jain 2019-06-25 11:07:06 PDT 
Created attachment 372846 [details]
Patch
Comment 2 Aakash Jain 2019-06-25 11:08:13 PDT 
Build step to analyze results from all the retries of layout-test will be added later-on in a separate patch.
Comment 3 Aakash Jain 2019-06-25 11:10:01 PDT 
Sample run: https://ews-build.webkit-uat.org/#/builders/35/builds/11
Comment 4 WebKit Commit Bot 2019-06-25 18:01:07 PDT 
Comment on attachment 372846 [details]
Patch

Clearing flags on attachment: 372846

Committed r246823: <https://trac.webkit.org/changeset/246823>
Comment 5 WebKit Commit Bot 2019-06-25 18:01:08 PDT 
All reviewed patches have been landed.  Closing bug.
Comment 6 Radar WebKit Bug Importer 2019-06-26 16:23:26 PDT 
<rdar://problem/52217478>
Comment 7 Radar WebKit Bug Importer 2019-06-26 16:23:29 PDT 
<rdar://problem/52217483>