Bug 230333 - REGRESSION(r282383): [WPE] Random run-webkit-tests early exits due to timeouts
Summary: REGRESSION(r282383): [WPE] Random run-webkit-tests early exits due to timeouts
Status: RESOLVED DUPLICATE of bug 230307
Alias: None
Product: WebKit
Classification: Unclassified
Component: WPE WebKit (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2021-09-15 19:08 PDT by Lauro Moura
Modified: 2021-09-15 19:37 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Lauro Moura 2021-09-15 19:08:29 PDT
Since r282383/241645@main, the WPE release test bot[1] has been either exiting early roughly half the time due to reaching the timeouts limits (50) between 40k and 50k tests run, or the number of unexpected flaky timeouts doubles from ~20 to ~40.

In the GTK-Release, a similar behavior appears but with just 1 or 2 flaky timeouts being more frequent, without major timeouts.

These are a few tests that have been consistently timing out in WPE-Release when the bots exit early (or flaky timeout when the bot passes):

fast/frames/lots-of-iframes.html
fast/frames/lots-of-objects.html
fast/selectors/matches-backtracking.html
http/tests/cache/disk-cache/redirect-chain-limits.html
http/tests/misc/large-js-program.py
http/tests/misc/repeat-open-cancel.html
http/tests/xmlhttprequest/redirect-cross-origin-tripmine.html
http/wpt/crypto/unwrap-rsa-key-crash.any.html

To reproduce the new timeouts, so far I had to run the entire WPE test suite.

Upstream (as of r282464):
* Unexpected timeouts: 48
* Total test time: 2318 seconds

With r282383 reverted:
* Unexpected timeouts: 13
* Total test time: 1333 seconds
Comment 1 Lauro Moura 2021-09-15 19:37:57 PDT
With bug230307's patch, the previous behavior is restored.

*** This bug has been marked as a duplicate of bug 230307 ***