Bug 231088 – [ macOS wk2 Release ] http/tests/loading/preload-slow-loading.py is a flaky failure

• Status: RESOLVED
• Resolution: CONFIGURATION CHANGED
• Component: New Bugs

http/tests/loading/preload-slow-loading.py

Is flaky failing on macOS wk2 Release.

History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Floading%2Fpreload-slow-loading.py

Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r283372%20(5539)/results.html

Diff: 

--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,6 +1,7 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
 non-existant-1 has MIME type text/html
+preload-slow-target.jpg has MIME type text/html
 non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame
 main frame - didHandleOnloadEventsForFrame

[Radar WebKit Bug Importer]

<rdar://problem/83774517>

According to the history, it looks like the test started being flaky recently, but the test failed locally as old as with r283100. (Tried with r283274, r283270, r283260,and r283100)

Updated the test expectations while investigating https://trac.webkit.org/changeset/283399/webkit

Marked a wrong test. Updated test expectations https://trac.webkit.org/changeset/283419/webkit

With r283274 & r283270, the diff was slightly different with one from the test run.

--- /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,8 +1,7 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
 non-existant-1 has MIME type text/html
-non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame
 main frame - didHandleOnloadEventsForFrame
 main frame - didFinishLoadForFrame
-");
+

With r283260 & r283100, the diff is same as one from the test run:

--- /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,5 +1,6 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
+preload-slow-target.jpg has MIME type text/html
 non-existant-1 has MIME type text/html
 non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame

I was able to reproduce the failure with the oldest revision available for BigSur (r268271) using run-webkit-tests --force --iterations 100 --exit-after-n-failures 1 http/tests/loading/preload-slow-loading.py -f

[Brent Fulgham]

Youenn confirmed this is resolved as of 3/14/2022.