NEW 171895
[wk2] Layout Test/webrtc/audio-replace-track.html is flaky 
https://bugs.webkit.org/show_bug.cgi?id=171895
Summary [wk2] Layout Test/webrtc/audio-replace-track.html is flaky
Matt Lewis
Reported 2017-05-09 16:22:42 PDT
the test webrtc/audio-replace-track.html is a flaky failure and timeout. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Faudio-replace-track.html build: https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/902 https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r216534%20(902)/results.html Diff: --- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-expected.txt +++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-actual.txt @@ -1,3 +1,3 @@ -PASS Replacing audio track from a peer connection +FAIL Replacing audio track from a peer connection promise_test: Unhandled rejection with value: object "TypeError: null is not an object (evaluating 'context.createMediaStreamSource')"
Attachments
Add attachment proposed patch, testcase, etc.
Matt Lewis
Comment 1 2017-05-09 16:28:28 PDT
Marked test as flaky https://trac.webkit.org/changeset/216557/webkit
Matt Lewis
Comment 2 2017-05-31 13:01:01 PDT
The test has now started to become flaky on iOS as well. Added to see also a bug that looks to be an attempt to help with flakiness. Oldest iOS failure on dashboard is on 5/22 with this build: https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/1677 additional diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-actual.txt @@ -1,6 +1,6 @@ PASS Starting an audio connection -PASS Ensuring mock audio source is received on the remote side +FAIL Ensuring mock audio source is received on the remote side assert_true: heard hum 1 expected true got false PASS Using replaceTrack for audio -PASS Ensuring remote audio gets the replacing track data +FAIL Ensuring remote audio gets the replacing track data assert_true: heard hum 2 expected true got false
Ryan Haddad
Comment 3 2017-06-02 16:08:24 PDT
Marked test as flaky on iOS and removed timeout expectation for macOS in https://trac.webkit.org/r217739
Radar WebKit Bug Importer
Comment 4 2017-06-02 17:12:20 PDT
<rdar://problem/32548741>
Note You need to log in before you can comment on or make changes to this bug.