Bug 225666

Summary: [ BigSur wk2 arm64 ] http/tests/cache/disk-cache/redirect-chain-limits.html (layout-test) is a flaky timeout
Product: WebKit Reporter: Robert Jenner <jenner>
Component: Page LoadingAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, beidson, koivisto, ryanhaddad, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2021-05-11 11:25:08 PDT
http/tests/cache/disk-cache/redirect-chain-limits.html

is a flaky timeout on macOS BigSur wk2 Release on Apple Silicon Macs only. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fcache%2Fdisk-cache%2Fredirect-chain-limits.html 


TIMEOUT TEXT:
-Test the limits of redirect chain length.
+#PID UNRESPONSIVE - WebKitTestRunner (pid 22545)
+FAIL: Timed out waiting for notifyDone to be called
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-
-
-Redirect chain length: 1
-Response status code: 200
-Response source: Disk cache
-
-Redirect chain length: 5
-Response status code: 200
-Response source: Disk cache
-
-Redirect chain length: 6
-Response status code: 200
-Response source: Network
-
-Redirect chain length: 20
-Response status code: 200
-Response source: Network
-
-Redirect chain length: 40
-Response status code: 0
-Response source: Null response
-
-PASS successfullyParsed is true
-
-TEST COMPLETE
-
+#EOF
+#EOF
Comment 1 Robert Jenner 2021-05-11 12:49:00 PDT
Upon further inspection it looks like this test also has a history of flaky timeouts on Debug as well. The first recorded timeout occurred at r276217 and has been inconsistent since.

Since this only occurs on Apple Silicon Macs, I can't reproduce the timeouts as I do not have access to said system type. 

I have updated the expectations to Pass Timeout here:
https://trac.webkit.org/changeset/277337/webkit
Comment 2 Radar WebKit Bug Importer 2021-05-11 12:49:20 PDT
<rdar://problem/77857419>
Comment 3 Alexey Proskuryakov 2021-05-12 10:16:41 PDT
This test is fairly slow on Intel too, taking ~11 seconds in WK2 Release. It is roughly 3x slower on Apple Silicon, which is surprising, but I'm not seeing the same on an internal bot. So this could be a configuration issue of some kind.
Comment 4 Robert Jenner 2021-05-12 15:55:12 PDT
As per @Alexey's recommendation, I have updated the test expectations to [ Slow ] instead of [ Pass Timeout ] here:
https://trac.webkit.org/changeset/277398/webkit
Comment 5 Robert Jenner 2021-05-13 17:54:46 PDT
There was an issue where the Mac mini this test was running on was using 10gb of its ram. This may have been the reason this test was timing out/running slow. I believe the ram usage issue has been resolved. I also marked the test as slow, and the test is now taking between 5-8 seconds to run and pass. Before, it was taking about 30 seconds to run.