Bug 171895
| Summary: | [wk2] Layout Test/webrtc/audio-replace-track.html is flaky | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Matt Lewis <jlewis3> |
| Component: | New Bugs | Assignee: | Nobody <webkit-unassigned> |
| Status: | NEW | ||
| Severity: | Normal | CC: | ryanhaddad, webkit-bug-importer, youennf |
| Priority: | P2 | Keywords: | InRadar |
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| See Also: |
https://bugs.webkit.org/show_bug.cgi?id=171815 https://bugs.webkit.org/show_bug.cgi?id=171292 https://bugs.webkit.org/show_bug.cgi?id=172645 |
||
Matt Lewis
the test webrtc/audio-replace-track.html is a flaky failure and timeout.
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Faudio-replace-track.html
build:
https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/902
https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r216534%20(902)/results.html
Diff:
--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-actual.txt
@@ -1,3 +1,3 @@
-PASS Replacing audio track from a peer connection
+FAIL Replacing audio track from a peer connection promise_test: Unhandled rejection with value: object "TypeError: null is not an object (evaluating 'context.createMediaStreamSource')"
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Matt Lewis
Marked test as flaky https://trac.webkit.org/changeset/216557/webkit
Matt Lewis
The test has now started to become flaky on iOS as well.
Added to see also a bug that looks to be an attempt to help with flakiness.
Oldest iOS failure on dashboard is on 5/22 with this build:
https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/1677
additional diff:
--- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-expected.txt
+++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/audio-replace-track-actual.txt
@@ -1,6 +1,6 @@
PASS Starting an audio connection
-PASS Ensuring mock audio source is received on the remote side
+FAIL Ensuring mock audio source is received on the remote side assert_true: heard hum 1 expected true got false
PASS Using replaceTrack for audio
-PASS Ensuring remote audio gets the replacing track data
+FAIL Ensuring remote audio gets the replacing track data assert_true: heard hum 2 expected true got false
Ryan Haddad
Marked test as flaky on iOS and removed timeout expectation for macOS in https://trac.webkit.org/r217739
Radar WebKit Bug Importer
<rdar://problem/32548741>