Bug 231088

Summary:	[ macOS wk2 Release ] http/tests/loading/preload-slow-loading.py is a flaky failure
Product:	WebKit	Reporter:	ayumi_kojima
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	bfulgham, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac (Intel)
OS:	Unspecified

ayumi_kojima

Reported 2021-10-01 11:21:12 PDT

http/tests/loading/preload-slow-loading.py Is flaky failing on macOS wk2 Release. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Floading%2Fpreload-slow-loading.py Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r283372%20(5539)/results.html Diff: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,6 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html +preload-slow-target.jpg has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame

Attachments
Add attachment proposed patch, testcase, etc.

Radar WebKit Bug Importer

Comment 1 2021-10-01 11:21:30 PDT

<rdar://problem/83774517>

ayumi_kojima

Comment 2 2021-10-01 14:03:48 PDT

According to the history, it looks like the test started being flaky recently, but the test failed locally as old as with r283100. (Tried with r283274, r283270, r283260,and r283100)

ayumi_kojima

Comment 3 2021-10-01 14:10:42 PDT

Updated the test expectations while investigating https://trac.webkit.org/changeset/283399/webkit

ayumi_kojima

Comment 4 2021-10-01 16:26:40 PDT

Marked a wrong test. Updated test expectations https://trac.webkit.org/changeset/283419/webkit

ayumi_kojima

Comment 5 2021-10-12 15:25:02 PDT

With r283274 & r283270, the diff was slightly different with one from the test run. --- /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/buildToTest/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,8 +1,7 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame non-existant-1 has MIME type text/html -non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame main frame - didHandleOnloadEventsForFrame main frame - didFinishLoadForFrame -"); + With r283260 & r283100, the diff is same as one from the test run: --- /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-expected.txt +++ /Volumes/Data/Builds/test-283100/layout-test-results/http/tests/loading/preload-slow-loading-actual.txt @@ -1,5 +1,6 @@ main frame - didStartProvisionalLoadForFrame main frame - didCommitLoadForFrame +preload-slow-target.jpg has MIME type text/html non-existant-1 has MIME type text/html non-existant-2 has MIME type text/html main frame - didFinishDocumentLoadForFrame

ayumi_kojima

Comment 6 2021-10-12 15:39:19 PDT

I was able to reproduce the failure with the oldest revision available for BigSur (r268271) using run-webkit-tests --force --iterations 100 --exit-after-n-failures 1 http/tests/loading/preload-slow-loading.py -f

Brent Fulgham

Comment 7 2022-06-23 14:27:18 PDT

Youenn confirmed this is resolved as of 3/14/2022.

Note You need to log in before you can comment on or make changes to this bug.