Bug 209194 - [ macOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html is flaky failing
Summary: [ macOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchr...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-03-17 13:34 PDT by Jacob Uphoff
Modified: 2020-05-14 12:05 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jacob Uphoff 2020-03-17 13:34:25 PDT
imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html

This test started to flaky fail pretty recently and the first failure was r258217

I ran the test with 'rwt --root release-258567 imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html --force -iterations 2000 -f' and it did not reproduce the failure.

History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCRtpReceiver-getSynchronizationSources.https.html&platform=mac

Diff:

--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-actual.txt
@@ -1,14 +1,16 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS [audio] getSynchronizationSources() eventually returns a non-empty list 
 PASS [audio] RTCRtpSynchronizationSource.timestamp is a number 
 PASS [audio] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
 FAIL [audio] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false
 PASS [audio] RTCRtpSynchronizationSource.source is a number 
-PASS [video] getSynchronizationSources() eventually returns a non-empty list 
-PASS [video] RTCRtpSynchronizationSource.timestamp is a number 
-PASS [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
-FAIL [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false
-PASS [video] RTCRtpSynchronizationSource.source is a number 
-PASS [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] 
-FAIL [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean assert_equals: expected "boolean" but got "undefined"
+TIMEOUT [video] getSynchronizationSources() eventually returns a non-empty list Test timed out
+NOTRUN [video] RTCRtpSynchronizationSource.timestamp is a number 
+NOTRUN [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
+NOTRUN [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() 
+NOTRUN [video] RTCRtpSynchronizationSource.source is a number 
+NOTRUN [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] 
+NOTRUN [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean
Comment 1 Radar WebKit Bug Importer 2020-03-17 13:34:45 PDT
<rdar://problem/60552675>
Comment 2 Jacob Uphoff 2020-03-17 13:38:49 PDT
This failure has been happening on macOS wk2 on debug and release
Comment 3 Jacob Uphoff 2020-03-17 13:47:04 PDT
Set test expectations here: https://trac.webkit.org/changeset/258585/webkit
Comment 4 Ryan Haddad 2020-05-14 12:05:03 PDT
The test is passing now. Removed expectation in r261702.