Bug 202854

Summary: [build.webkit.org] API tests should output result summary in json format
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, commit-queue, jbedard, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=189417
Attachments:
Description Flags
Patch none

Aakash Jain
Reported 2019-10-11 10:55:32 PDT
API tests should output result in json format as well. This would be useful in easily looking at just the results (without the complete stdio logs). Currently to find out the api test failure name, one has to scroll through the large stdio logs, and find the failure. EWS output results in json format already, e.g.: https://ews-build.webkit.org/#/builders/3/builds/10037/steps/9/logs/json
Attachments
Patch (1.41 KB, patch)
2019-10-11 10:57 PDT, Aakash Jain 		no flags
DetailsFormatted DiffDiff
View All Add attachment proposed patch, testcase, etc.
Aakash Jain
Comment 1 2019-10-11 10:57:04 PDT
Created attachment 380765 [details] Patch
Jonathan Bedard
Comment 2 2019-10-11 11:11:24 PDT
Comment on attachment 380765 [details] Patch What is the long-term plan for this?
Jonathan Bedard
Comment 3 2019-10-11 11:30:52 PDT
Comment on attachment 380765 [details] Patch Forgot this json only has the failed tests, so it's actually pretty human readable.
WebKit Commit Bot
Comment 4 2019-10-11 12:17:25 PDT
Comment on attachment 380765 [details] Patch Clearing flags on attachment: 380765 Committed r251017: <https://trac.webkit.org/changeset/251017>
WebKit Commit Bot
Comment 5 2019-10-11 12:17:26 PDT
All reviewed patches have been landed. Closing bug.
Radar WebKit Bug Importer
Comment 6 2019-10-15 16:49:58 PDT
<rdar://problem/56313806>
Aakash Jain
Comment 7 2019-11-13 03:23:05 PST
build.webkit.org server was restarted yet, and this change is live. It is working fine, e.g.: https://build.webkit.org/builders/Apple%20High%20Sierra%20Debug%20WK1%20%28Tests%29/builds/11772/steps/run-api-tests/logs/json
Note You need to log in before you can comment on or make changes to this bug.