Bug 197662 – [macOS / iOS ] Layout Test imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https.html a flaky failure

• Status: NEW
• Component: WebRTC

[Ryan Haddad]

The following layout test is flaky on macOS and iOS Debug bots

imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https.html

Probable cause:

Unknown, the test flakiness exceeds the visible history on the dashboard.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-getStats.https.html

--- /Volumes/Data/slave/highsierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https-expected.txt
+++ /Volumes/Data/slave/highsierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https-actual.txt
@@ -11,7 +11,7 @@
 PASS getStats() with no argument should return stats report containing peer-connection stats on an empty PC 
 FAIL getStats() with no argument should return stats report containing peer-connection stats and outbound-track-stats assert_true: Expect statsReport to contain stats object of type outbound-rtp expected true got false
 FAIL getStats() with no argument should return stats for no-stream tracks assert_true: Expect statsReport to contain stats object of type outbound-rtp expected true got false
-FAIL getStats() on track associated with RtpSender should return stats report containing outbound-rtp stats assert_equals: Expect dictionary.ip to be string expected "string" but got "undefined"
+FAIL getStats() on track associated with RtpSender should return stats report containing outbound-rtp stats assert_true: Expect dictionary.state to have one of the valid enum values: frozen,waiting,in-progress,failed,succeeded expected true got false
 TIMEOUT getStats() on track associated with RtpReceiver should return stats report containing inbound-rtp stats Test timed out
 FAIL getStats() with connected peer connections having tracks and data channel should return all mandatory to implement stats assert_unreached: test failed with error: Error: assert_true: Expect dictionary.dataChannelIdentifier to be integer expected true got false Reached unreachable code

[Ryan Haddad]

Marked as flaky in http://trac.webkit.org/projects/webkit/changeset/245010

[Radar WebKit Bug Importer]

<rdar://problem/50547094>

[Truitt Savell]

This test recently regressed further and began failing on Release queues as well. 

It looks like this regressed with the resync in https://trac.webkit.org/changeset/270252/webkit

[Truitt Savell]

Updated expectations in https://trac.webkit.org/changeset/270329/webkit