Bug 231329 - REGRESSION (iOS 15): http/tests/websocket/tests/hybi/close-code-and-reason.html is failing
Summary: REGRESSION (iOS 15): http/tests/websocket/tests/hybi/close-code-and-reason.ht...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: iPhone / iPad Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-06 13:47 PDT by ayumi_kojima
Modified: 2022-06-30 15:34 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-10-06 13:47:03 PDT
http/tests/websocket/tests/hybi/close-code-and-reason.html

Is flaky failing on iOS 15 Release and constantly failing on iOS 15 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fclose-code-and-reason.html

According to the history, the test started failing on iOS 15.

Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r283612%20(72)/results.html

Diff:

--- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/close-code-and-reason-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/close-code-and-reason-actual.txt
@@ -39,43 +39,43 @@
 WebSocketTest.onopen() was called with testId = 3.
 WebSocketTest.onclose() was called with testId = 3.
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1005.
 PASS closeEvent.reason is ''
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1005.
 PASS closeEvent.reason is ''
 WebSocketTest.onopen() was called with testId = 4.
 WebSocketTest.onclose() was called with testId = 4.
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1005.
 PASS closeEvent.reason is ''
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1005.
 PASS closeEvent.reason is ''
 WebSocketTest.onopen() was called with testId = 5.
 WebSocketTest.onclose() was called with testId = 5.
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
-PASS closeEvent.reason is ''
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1015.
+FAIL closeEvent.reason should be . Was baz.
 PASS typeof closeEvent.wasClean is 'boolean'
-PASS closeEvent.wasClean is false
-PASS closeEvent.code is 1006
-PASS closeEvent.reason is ''
+FAIL closeEvent.wasClean should be false. Was true.
+FAIL closeEvent.code should be 1006. Was 1015.
+FAIL closeEvent.reason should be . Was baz.
 WebSocketTest.onopen() was called with testId = 6.
 WebSocketTest.onclose() was called with testId = 6.
 PASS typeof closeEvent.wasClean is 'boolean'
 PASS closeEvent.wasClean is true
-PASS closeEvent.code is 65535
-PASS closeEvent.reason is 'good bye'
+FAIL closeEvent.code should be 65535. Was 1005.
+FAIL closeEvent.reason should be good bye. Was .
 PASS typeof closeEvent.wasClean is 'boolean'
 PASS closeEvent.wasClean is true
-PASS closeEvent.code is 65535
-PASS closeEvent.reason is 'good bye'
+FAIL closeEvent.code should be 65535. Was 1005.
+FAIL closeEvent.reason should be good bye. Was .
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 1 Radar WebKit Bug Importer 2021-10-06 13:47:32 PDT
<rdar://problem/83950001>
Comment 2 ayumi_kojima 2021-10-06 14:09:01 PDT
In the meantime, marked test expectations: https://trac.webkit.org/changeset/283661/webkit
Comment 3 youenn fablet 2022-06-23 03:42:30 PDT
Pull request: https://github.com/WebKit/WebKit/pull/1724
Comment 4 EWS 2022-06-30 15:34:24 PDT
Committed 252017@main (19a3f253f03d): <https://commits.webkit.org/252017@main>

Reviewed commits have been landed. Closing PR #1724 and removing active labels.