imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window.html Is a flaky failure on macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS. The flaky failure is seen (though really flaky) in the open source directory: https://results.webkit.org/?suite=layout-tests&test=imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window.html The test became flaky on EWS at https://ews-build.webkit.org/#/builders/60/builds/7830 Diff: --- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-expected.txt +++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-actual.txt @@ -4,7 +4,7 @@ PASS cross-origin, CORS-safelisted: status = 307, type = form PASS cross-origin, CORS-safelisted: status = 307, type = blob PASS cross-origin, CORS-safelisted: status = 308, type = string -PASS cross-origin, CORS-safelisted: status = 308, type = arraybuffer +FAIL cross-origin, CORS-safelisted: status = 308, type = arraybuffer assert_true: timeout expected true got false PASS cross-origin, CORS-safelisted: status = 308, type = form PASS cross-origin, CORS-safelisted: status = 308, type = blob
<rdar://problem/82695630>
Marked expectations: https://trac.webkit.org/changeset/281959/webkit
The test timed out locally on BigSur AS instead of failing.The test hanged with --no-timeout. Diff: --- /Volumes/Data/Builds/debugToTest/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-expected.txt +++ /Volumes/Data/Builds/debugToTest/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-actual.txt @@ -1,10 +1,3 @@ +FAIL: Timed out waiting for notifyDone to be called -PASS cross-origin, CORS-safelisted: status = 307, type = string -PASS cross-origin, CORS-safelisted: status = 307, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 307, type = form -PASS cross-origin, CORS-safelisted: status = 307, type = blob -PASS cross-origin, CORS-safelisted: status = 308, type = string -PASS cross-origin, CORS-safelisted: status = 308, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 308, type = form -PASS cross-origin, CORS-safelisted: status = 308, type = blob
I was able to reproduce the failure (with a different diff) locally on Catalina using run-webkit-tests --iterations 500 --exit-after-n-failures 1 --force imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window.html Diff: --- /Volumes/Data/Builds/Jazz/buildToTest/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-expected.txt +++ /Volumes/Data/Builds/Jazz/buildToTest/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-actual.txt @@ -1,10 +1,12 @@ -PASS cross-origin, CORS-safelisted: status = 307, type = string -PASS cross-origin, CORS-safelisted: status = 307, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 307, type = form -PASS cross-origin, CORS-safelisted: status = 307, type = blob -PASS cross-origin, CORS-safelisted: status = 308, type = string -PASS cross-origin, CORS-safelisted: status = 308, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 308, type = form -PASS cross-origin, CORS-safelisted: status = 308, type = blob +Harness Error (TIMEOUT), message = null +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = string Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = arraybuffer Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = form Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = blob Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = string Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = arraybuffer Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = form Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = blob Test timed out +
Test also failed at https://trac.webkit.org/changeset/279224/webkit --- /Volumes/Data/Builds/Jazz/test-279224/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-expected.txt +++ /Volumes/Data/Builds/Jazz/test-279224/layout-test-results/imported/w3c/web-platform-tests/beacon/beacon-redirect.https.window-actual.txt @@ -1,10 +1,12 @@ -PASS cross-origin, CORS-safelisted: status = 307, type = string -PASS cross-origin, CORS-safelisted: status = 307, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 307, type = form -PASS cross-origin, CORS-safelisted: status = 307, type = blob -PASS cross-origin, CORS-safelisted: status = 308, type = string -PASS cross-origin, CORS-safelisted: status = 308, type = arraybuffer -PASS cross-origin, CORS-safelisted: status = 308, type = form -PASS cross-origin, CORS-safelisted: status = 308, type = blob +Harness Error (TIMEOUT), message = null +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = string Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = arraybuffer Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = form Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 307, type = blob Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = string Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = arraybuffer Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = form Test timed out +TIMEOUT cross-origin, CORS-safelisted: status = 308, type = blob Test timed out +
This test no longer exists.
(In reply to Chris Dumez from comment #6) > This test no longer exists. I got confused, it is LayoutTests/imported/w3c/web-platform-tests/beacon/beacon-redirect.sub.window.html that is gone. The name is very similar but not quite the same.