http/tests/loading/preload-slow-loading.py Is flaky failing on macOS wk2 Release. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Floading%2Fpreload-slow-loading.py Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r283372%20(5539)/results.html Diff: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,6 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html +preload-slow-target.jpg has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame
<rdar://problem/83774517>
According to the history, it looks like the test started being flaky recently, but the test failed locally as old as with r283100. (Tried with r283274, r283270, r283260,and r283100)
Updated the test expectations while investigating https://trac.webkit.org/changeset/283399/webkit
Marked a wrong test. Updated test expectations https://trac.webkit.org/changeset/283419/webkit
With r283274 & r283270, the diff was slightly different with one from the test run. --- /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,8 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html -non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame main frame - didFinishLoadForFrame -"); + With r283260 & r283100, the diff is same as one from the test run: --- /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,5 +1,6 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame +preload-slow-target.jpg has MIME type text/html non-existant-1 has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame
I was able to reproduce the failure with the oldest revision available for BigSur (r268271) using run-webkit-tests --force --iterations 100 --exit-after-n-failures 1 http/tests/loading/preload-slow-loading.py -f
Youenn confirmed this is resolved as of 3/14/2022.