Bug 196633

Summary: [Mac WK2 iOS Sim] Layout Test imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html is a flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: youenn fablet <youennf>
Status: RESOLVED FIXED    
Severity: Normal CC: achristensen, commit-queue, eric.carlson, lforschler, ryanhaddad, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=195831
Attachments:
Description Flags
Patch none

Description Shawn Roberts 2019-04-04 16:20:42 PDT 
The following layout test is flaky on Mac WK2 Release and Debug, iOS Simulator Release and Debug

imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html

Probable cause:

Test was imported in https://trac.webkit.org/changeset/243041/webkit and has been a flaky failure and timeout on High Sierra. Also is a flaky failure on Mojave and iOS Simulator Release and Debug.

Reproducible with:

run-webkit-tests imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html --iterations 25 -f

Failed twice, fails a lot more consistently in Debug.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCRtpReceiver-getSynchronizationSources.https.html

Diff:

--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-actual.txt
@@ -9,6 +9,6 @@
 PASS [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
 FAIL [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false
 PASS [video] RTCRtpSynchronizationSource.source is a number 
-FAIL [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] assert_less_than_equal: expected a number less than or equal to 1 but got 23
+FAIL [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] assert_less_than_equal: expected a number less than or equal to 1 but got 9
 FAIL [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean assert_equals: expected "boolean" but got "undefined"
Comment 1 Radar WebKit Bug Importer 2019-04-04 16:21:20 PDT 
<rdar://problem/49627667>
Comment 2 Ryan Haddad 2019-04-05 14:55:46 PDT 
Marked test as flaky in https://trac.webkit.org/changeset/243945/webkit
Comment 3 youenn fablet 2019-04-25 17:14:03 PDT 
Created attachment 368290 [details]
Patch
Comment 4 WebKit Commit Bot 2019-04-26 09:29:21 PDT 
Comment on attachment 368290 [details]
Patch

Clearing flags on attachment: 368290

Committed r244689: <https://trac.webkit.org/changeset/244689>
Comment 5 WebKit Commit Bot 2019-04-26 09:29:22 PDT 
All reviewed patches have been landed.  Closing bug.