Bug 223385 - [ BigSur+ iOS Release wk2 ] 2 imported/w3c/web-platform-tests/webrtc are flakey text failures
Summary: [ BigSur+ iOS Release wk2 ] 2 imported/w3c/web-platform-tests/webrtc are fla...
Status: RESOLVED DUPLICATE of bug 231223
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-03-17 10:22 PDT by Robert Jenner
Modified: 2024-05-29 17:36 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-03-17 10:22:11 PDT
imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html
imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-addIceCandidate-connectionSetup.html

Are flakey text failures on BigSur wk2 on Apple Silicon only.

Both tests are flakey on release, but "imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-addIceCandidate-connectionSetup.html" has failed once or twice on debug as well. 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCDtlsTransport-state.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-addIceCandidate-connectionSetup.html&architecture=arm64

TEXT DIFF for "imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html":
@@ -1,3 +1,5 @@
+
+Harness Error (FAIL), message = Unhandled rejection: The object is in an invalid state.
 
 FAIL DTLS transport goes to connected state promise_test: Unhandled rejection with value: object "ReferenceError: Can't find variable: RTCDtlsTransport"
 FAIL close() causes the local transport to close immediately promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'dtlstransport.state')"


TEXT DIFF for "imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-addIceCandidate-connectionSetup.html"
@@ -1,3 +1,5 @@
+
+Harness Error (FAIL), message = Unhandled rejection: The object is in an invalid state.
 
 FAIL Candidates are added dynamically; connection should work promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'transport.state')"
 FAIL Candidates are added at PC1; connection should work promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'transport.state')"
Comment 1 Radar WebKit Bug Importer 2021-03-17 10:23:45 PDT
<rdar://problem/75532545>
Comment 2 Robert Jenner 2021-03-17 10:41:33 PDT
Updated test expectations here: 
https://trac.webkit.org/changeset/274571/webkit
Comment 3 Robert Jenner 2021-07-22 16:40:02 PDT
It appears this affects more than Apple Silicon Macs. It also appears to be affecting BigSur and higher, as well as iOS 14 release. I have updated the expectations for these tests as such:
https://trac.webkit.org/changeset/280207/webkit
Comment 4 youenn fablet 2021-10-05 02:49:39 PDT

*** This bug has been marked as a duplicate of bug 231223 ***
Comment 5 Ben Schwartz 2024-05-29 17:31:36 PDT
Removing stale test expectations.
Comment 6 EWS 2024-05-29 17:36:29 PDT
Test gardening commit 279480@main (940c26d7e85b): <https://commits.webkit.org/279480@main>

Reviewed commits have been landed. Closing PR #29269 and removing active labels.