231088 2021-10-01 11:21:12 -0700 [ macOS wk2 Release ] http/tests/loading/preload-slow-loading.py is a flaky failure 2022-06-23 14:27:18 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Mac (Intel) Unspecified RESOLVED CONFIGURATION CHANGED InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned bfulgham webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1799413 0 ayumi_kojima 2021-10-01 11:21:12 -0700 http/tests/loading/preload-slow-loading.py Is flaky failing on macOS wk2 Release. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Floading%2Fpreload-slow-loading.py Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r283372%20(5539)/results.html Diff: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,6 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html +preload-slow-target.jpg has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame 1799414 1 webkit-bug-importer 2021-10-01 11:21:30 -0700 <rdar://problem/83774517> 1799531 2 ayumi_kojima 2021-10-01 14:03:48 -0700 According to the history, it looks like the test started being flaky recently, but the test failed locally as old as with r283100. (Tried with r283274, r283270, r283260,and r283100) 1799535 3 ayumi_kojima 2021-10-01 14:10:42 -0700 Updated the test expectations while investigating https://trac.webkit.org/changeset/283399/webkit 1799614 4 ayumi_kojima 2021-10-01 16:26:40 -0700 Marked a wrong test. Updated test expectations https://trac.webkit.org/changeset/283419/webkit 1803472 5 ayumi_kojima 2021-10-12 15:25:02 -0700 With r283274 & r283270, the diff was slightly different with one from the test run. --- /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,8 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html -non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame main frame - didFinishLoadForFrame -"); + With r283260 & r283100, the diff is same as one from the test run: --- /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,5 +1,6 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame +preload-slow-target.jpg has MIME type text/html non-existant-1 has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame 1803484 6 ayumi_kojima 2021-10-12 15:39:19 -0700 I was able to reproduce the failure with the oldest revision available for BigSur (r268271) using run-webkit-tests --force --iterations 100 --exit-after-n-failures 1 http/tests/loading/preload-slow-loading.py -f 1877860 7 bfulgham 2022-06-23 14:27:18 -0700 Youenn confirmed this is resolved as of 3/14/2022.