Bug 203678

Summary: [EWS] Limit API tests failures to display in the status-bubble tooltip and buildbot summary
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, commit-queue, jbedard, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=214085
Attachments:
Description Flags
Patch none

Description Aakash Jain 2019-10-31 07:18:24 PDT
Sometimes a patch can break hundreds of API tests. In those cases, the status-bubble tries to display all those hundreds of failures, and becomes unreadable. Similarly buildbot build page display all the failing test names in the summary string, and becomes pretty unreadable. For e.g.: https://ews-build.webkit.org/#/builders/3/builds/11258 has 788 API test failures and the build page is unreadable.

We should limit the number of failures to display in the status-bubble and summary strings. Complete list of failing tests can still be seen in the logs of the test-run and the json output.
Comment 1 Aakash Jain 2019-10-31 07:50:40 PDT
Created attachment 382458 [details]
Patch
Comment 2 Aakash Jain 2019-10-31 07:53:05 PDT
Sample run: https://ews-build.webkit-uat.org/#/builders/4/builds/61
Comment 3 Jonathan Bedard 2019-10-31 08:18:21 PDT
(In reply to Aakash Jain from comment #2)
> Sample run: https://ews-build.webkit-uat.org/#/builders/4/builds/61

What does this look like in tooltips?
Comment 4 Aakash Jain 2019-10-31 08:19:21 PDT
> What does this look like in tooltips?
https://ews.webkit-uat.org/status-bubble/381964/
Comment 5 WebKit Commit Bot 2019-10-31 08:42:56 PDT
Comment on attachment 382458 [details]
Patch

Clearing flags on attachment: 382458

Committed r251849: <https://trac.webkit.org/changeset/251849>
Comment 6 WebKit Commit Bot 2019-10-31 08:42:58 PDT
All reviewed patches have been landed.  Closing bug.
Comment 7 Radar WebKit Bug Importer 2019-10-31 08:43:18 PDT
<rdar://problem/56782288>
Comment 8 Aakash Jain 2019-11-07 10:54:38 PST
Recent examples where this change was helpful in keeping the UI readable:
https://ews-build.webkit.org/#/builders/9/builds/11552
https://ews-build.webkit.org/#/builders/3/builds/11613

Corresponding Status bubble in: https://bugs.webkit.org/show_bug.cgi?id=203880