Bug 231088

Summary:	[ macOS wk2 Release ] http/tests/loading/preload-slow-loading.py is a flaky failure
Product:	WebKit	Reporter:	ayumi_kojima
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	bfulgham, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac (Intel)
OS:	Unspecified

Description ayumi_kojima 2021-10-01 11:21:12 PDT

http/tests/loading/preload-slow-loading.py

Is flaky failing on macOS wk2 Release.

History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Floading%2Fpreload-slow-loading.py

Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r283372%20(5539)/results.html

Diff: 

--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,6 +1,7 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
 non-existant-1 has MIME type text/html
+preload-slow-target.jpg has MIME type text/html
 non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame
 main frame - didHandleOnloadEventsForFrame

Comment 1 Radar WebKit Bug Importer 2021-10-01 11:21:30 PDT

<rdar://problem/83774517>

Comment 2 ayumi_kojima 2021-10-01 14:03:48 PDT

According to the history, it looks like the test started being flaky recently, but the test failed locally as old as with r283100. (Tried with r283274, r283270, r283260,and r283100)

Comment 3 ayumi_kojima 2021-10-01 14:10:42 PDT

Updated the test expectations while investigating https://trac.webkit.org/changeset/283399/webkit

Comment 4 ayumi_kojima 2021-10-01 16:26:40 PDT

Marked a wrong test. Updated test expectations https://trac.webkit.org/changeset/283419/webkit

Comment 5 ayumi_kojima 2021-10-12 15:25:02 PDT

With r283274 & r283270, the diff was slightly different with one from the test run.

--- /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,8 +1,7 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
 non-existant-1 has MIME type text/html
-non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame
 main frame - didHandleOnloadEventsForFrame
 main frame - didFinishLoadForFrame
-");
+

With r283260 & r283100, the diff is same as one from the test run:

--- /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt
+++ /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt
@@ -1,5 +1,6 @@
 main frame - didStartProvisionalLoadForFrame
 main frame - didCommitLoadForFrame
+preload-slow-target.jpg has MIME type text/html
 non-existant-1 has MIME type text/html
 non-existant-2 has MIME type text/html
 main frame - didFinishDocumentLoadForFrame

Comment 6 ayumi_kojima 2021-10-12 15:39:19 PDT

I was able to reproduce the failure with the oldest revision available for BigSur (r268271) using run-webkit-tests --force --iterations 100 --exit-after-n-failures 1 http/tests/loading/preload-slow-loading.py -f

Comment 7 Brent Fulgham 2022-06-23 14:27:18 PDT

Youenn confirmed this is resolved as of 3/14/2022.