Bug 230333

Summary: REGRESSION(r282383): [WPE] Random run-webkit-tests early exits due to timeouts
Product: WebKit Reporter: Lauro Moura <lmoura>
Component: WPE WebKitAssignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: bugs-noreply, cgarcia, clopez
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=230214

Description Lauro Moura 2021-09-15 19:08:29 PDT
Since r282383/241645@main, the WPE release test bot[1] has been either exiting early roughly half the time due to reaching the timeouts limits (50) between 40k and 50k tests run, or the number of unexpected flaky timeouts doubles from ~20 to ~40.

In the GTK-Release, a similar behavior appears but with just 1 or 2 flaky timeouts being more frequent, without major timeouts.

These are a few tests that have been consistently timing out in WPE-Release when the bots exit early (or flaky timeout when the bot passes):

fast/frames/lots-of-iframes.html
fast/frames/lots-of-objects.html
fast/selectors/matches-backtracking.html
http/tests/cache/disk-cache/redirect-chain-limits.html
http/tests/misc/large-js-program.py
http/tests/misc/repeat-open-cancel.html
http/tests/xmlhttprequest/redirect-cross-origin-tripmine.html
http/wpt/crypto/unwrap-rsa-key-crash.any.html

To reproduce the new timeouts, so far I had to run the entire WPE test suite.

Upstream (as of r282464):
* Unexpected timeouts: 48
* Total test time: 2318 seconds

With r282383 reverted:
* Unexpected timeouts: 13
* Total test time: 1333 seconds
Comment 1 Lauro Moura 2021-09-15 19:37:57 PDT
With bug230307's patch, the previous behavior is restored.

*** This bug has been marked as a duplicate of bug 230307 ***