Bug 205608 – [GTK][WPE] Report number of total tests run and failed in API test runner like run-api-tests does

• Status: RESOLVED
• Resolution: FIXED
• Component: WebKitGTK

[Carlos Alberto Lopez Perez]

We can reuse and simplify the implementation of bug 202361 a lot by outputting at the end of the run-gtk-tests/run-wpe-tests step the information about the number of tests ran and failed like run-api-tests does:

"Ran X tests of Y with Z successful"
Where:
X=total number of tests executed
Y=total number of tests available
Z=total number of tests that passed (or that failed as expected)

If we do this, we can basically use the same logic on the EWS (and buildbot) for running the gtk and mac/ios API tests.

[Carlos Alberto Lopez Perez]

Created attachment 386450 [details]
Patch

Patch doesn't apply because it is implemented on top of the changes from bug 205579

[Carlos Alberto Lopez Perez]

(In reply to Carlos Alberto Lopez Perez from comment #1)
> Created attachment 386450 [details]
> Patch
> 
> Patch doesn't apply because it is implemented on top of the changes from bug
> 205579

mmmm, seems it applies anyway.. good :)

[Carlos Alberto Lopez Perez]

Comment on attachment 386450 [details]
Patch

Clearing flags on attachment: 386450

Committed r253947: <https://trac.webkit.org/changeset/253947>

[Carlos Alberto Lopez Perez]

All reviewed patches have been landed.  Closing bug.

[Aakash Jain]

Does this script output results in json format as well? If not, we would need that as well. EWS use json output to parse the name of failing tests.

[Carlos Alberto Lopez Perez]

(In reply to Aakash Jain from comment #5)
> Does this script output results in json format as well? If not, we would
> need that as well. EWS use json output to parse the name of failing tests.

Yes, it does now. See bug 205579