Bug 232252

Summary: [ iOS15 Sim Release ] imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html is a flaky failure (Harness Error (TIMEOUT))
Product: WebKit Reporter: Eric Hutchison <ehutchison>
Component: WebRTCAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ehutchison, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Eric Hutchison 2021-10-25 10:46:26 PDT
imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html

is a flaky failure on iOS15 Simulator

History: https://results.webkit.org/?suite=layout-tests&test=imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html

Build: https://ews-build.webkit.org/#/builders/68/builds/371

Results: https://ews-build.s3-us-west-2.amazonaws.com/iOS-15-Simulator-WK2-Tests-EWS/r442349-371/results.html

Diff:

--- /Volumes/Data/worker/iOS-15-Simulator-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state-expected.txt
+++ /Volumes/Data/worker/iOS-15-Simulator-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state-actual.txt
@@ -1,6 +1,8 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS DTLS transport goes to connected state
 FAIL close() causes the local transport to close immediately assert_equals: expected "closed" but got "connected"
-PASS close() causes the other end's DTLS transport to close
-FAIL stop bundled transceiver retains dtls transport state assert_equals: getReceivers does not expose a receiver of a stopped transceiver expected 1 but got 2
+TIMEOUT close() causes the other end's DTLS transport to close Test timed out
+NOTRUN stop bundled transceiver retains dtls transport state

Reproduced text failure locally using run-webkit-tests --ios-simulator --release --iterations 100 --exit-after-n-failures 1 --clobber-old-results --force imported/w3c/web-platform-tests/webrtc/RTCDtlsTransport-state.html on r284787.
Comment 1 Radar WebKit Bug Importer 2021-10-25 10:46:54 PDT
<rdar://problem/84620854>
Comment 2 Eric Hutchison 2021-10-25 10:57:07 PDT
Updated test expectations at https://trac.webkit.org/changeset/284795/webkit