Bug 197662 - [macOS / iOS ] Layout Test imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https.html a flaky failure
Summary: [macOS / iOS ] Layout Test imported/w3c/web-platform-tests/webrtc/RTCPeerConn...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-05-07 09:00 PDT by Ryan Haddad
Modified: 2020-12-01 15:01 PST (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2019-05-07 09:00:25 PDT
The following layout test is flaky on macOS and iOS Debug bots

imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https.html

Probable cause:

Unknown, the test flakiness exceeds the visible history on the dashboard.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-getStats.https.html

--- /Volumes/Data/slave/highsierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https-expected.txt
+++ /Volumes/Data/slave/highsierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-getStats.https-actual.txt
@@ -11,7 +11,7 @@
 PASS getStats() with no argument should return stats report containing peer-connection stats on an empty PC 
 FAIL getStats() with no argument should return stats report containing peer-connection stats and outbound-track-stats assert_true: Expect statsReport to contain stats object of type outbound-rtp expected true got false
 FAIL getStats() with no argument should return stats for no-stream tracks assert_true: Expect statsReport to contain stats object of type outbound-rtp expected true got false
-FAIL getStats() on track associated with RtpSender should return stats report containing outbound-rtp stats assert_equals: Expect dictionary.ip to be string expected "string" but got "undefined"
+FAIL getStats() on track associated with RtpSender should return stats report containing outbound-rtp stats assert_true: Expect dictionary.state to have one of the valid enum values: frozen,waiting,in-progress,failed,succeeded expected true got false
 TIMEOUT getStats() on track associated with RtpReceiver should return stats report containing inbound-rtp stats Test timed out
 FAIL getStats() with connected peer connections having tracks and data channel should return all mandatory to implement stats assert_unreached: test failed with error: Error: assert_true: Expect dictionary.dataChannelIdentifier to be integer expected true got false Reached unreachable code
Comment 1 Ryan Haddad 2019-05-07 11:07:00 PDT
Marked as flaky in http://trac.webkit.org/projects/webkit/changeset/245010
Comment 2 Radar WebKit Bug Importer 2019-05-07 11:07:17 PDT
<rdar://problem/50547094>
Comment 3 Truitt Savell 2020-12-01 14:51:26 PST
This test recently regressed further and began failing on Release queues as well. 

It looks like this regressed with the resync in https://trac.webkit.org/changeset/270252/webkit
Comment 4 Truitt Savell 2020-12-01 15:01:09 PST
Updated expectations in https://trac.webkit.org/changeset/270329/webkit