209194 2020-03-17 13:34:25 -0700 [ macOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html is flaky failing 2020-05-14 12:05:03 -0700 1 1 1 Unclassified WebKit WebRTC WebKit Nightly Build Unspecified Unspecified RESOLVED CONFIGURATION CHANGED InRadar P2 Normal --- 1 jacob_uphoff webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1630862 0 jacob_uphoff 2020-03-17 13:34:25 -0700 imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html This test started to flaky fail pretty recently and the first failure was r258217 I ran the test with 'rwt --root release-258567 imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html --force -iterations 2000 -f' and it did not reproduce the failure. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCRtpReceiver-getSynchronizationSources.https.html&platform=mac Diff: --- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-expected.txt +++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-actual.txt @@ -1,14 +1,16 @@ + +Harness Error (TIMEOUT), message = null PASS [audio] getSynchronizationSources() eventually returns a non-empty list PASS [audio] RTCRtpSynchronizationSource.timestamp is a number PASS [audio] getSynchronizationSources() does not contain SSRCs older than 10 seconds FAIL [audio] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false PASS [audio] RTCRtpSynchronizationSource.source is a number -PASS [video] getSynchronizationSources() eventually returns a non-empty list -PASS [video] RTCRtpSynchronizationSource.timestamp is a number -PASS [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds -FAIL [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false -PASS [video] RTCRtpSynchronizationSource.source is a number -PASS [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] -FAIL [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean assert_equals: expected "boolean" but got "undefined" +TIMEOUT [video] getSynchronizationSources() eventually returns a non-empty list Test timed out +NOTRUN [video] RTCRtpSynchronizationSource.timestamp is a number +NOTRUN [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds +NOTRUN [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() +NOTRUN [video] RTCRtpSynchronizationSource.source is a number +NOTRUN [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] +NOTRUN [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean 1630863 1 webkit-bug-importer 2020-03-17 13:34:45 -0700 <rdar://problem/60552675> 1630864 2 jacob_uphoff 2020-03-17 13:38:49 -0700 This failure has been happening on macOS wk2 on debug and release 1630867 3 jacob_uphoff 2020-03-17 13:47:04 -0700 Set test expectations here: https://trac.webkit.org/changeset/258585/webkit 1652733 4 ryanhaddad 2020-05-14 12:05:03 -0700 The test is passing now. Removed expectation in r261702.