Bug 177501 – Layout Test webrtc/video-mute.html is flaky.

• Status: RESOLVED
• Resolution: FIXED
• Component: WebRTC

[Matt Lewis]

webrtc/video-mute.html is a flaky timeout on iOS 11 Release WK2 according to the flakiness dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fvideo-mute.html

build:
https://build.webkit.org/results/Apple%20iOS%2011%20Simulator%20Release%20WK2%20(Tests)/r222503%20(118)/results.html

Diff:

--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/webrtc/video-mute-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/webrtc/video-mute-actual.txt
@@ -1,11 +1,5 @@
-Video should be running, go to black and running.
-Following, should be a snapshot of the video, a black frame and a snapshot of the video.
-  
+#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 25137)
+FAIL: Timed out waiting for notifyDone to be called
 
-PASS Setting video exchange 
-PASS Ensuring connection state is connected 
-PASS Track is enabled, video should not be black 
-PASS Track is disabled, video should be black 
-PASS If disabled, black frames should still be coming 
-PASS Track is enabled, video should not be black 
-
+#EOF
+#EOF

[Matt Lewis]

Marked the test as flaky on iOS and High Sierra.

https://trac.webkit.org/changeset/224036/webkit

[Ryan Haddad]

This also happens on Sierra. Updated TestExpectations in https://trac.webkit.org/r227250.

[Matt Lewis]

This has started failing consistently on iOS 11 Simulator but has since started to pass on macOS:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fvideo-mute.html

Strangely, There is no diff for the test.

[Matt Lewis]

Refiling bug for iOS failure.

[youenn fablet]

Created attachment 350025 [details]
Patch

[EWS Watchlist]

Comment on attachment 350025 [details]
Patch

Attachment 350025 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: https://webkit-queues.webkit.org/results/9258357

New failing tests:
webrtc/video-mute.html

[EWS Watchlist]

Created attachment 350035 [details]
Archive of layout-test-results from ews126 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews126  Port: ios-simulator-wk2  Platform: Mac OS X 10.13.6

[youenn fablet]

Created attachment 350065 [details]
Patch

[youenn fablet]

Created attachment 350067 [details]
Patch

[WebKit Commit Bot]

Comment on attachment 350067 [details]
Patch

Rejecting attachment 350067 [details] from commit-queue.

Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.webkit.org', '--bot-id=webkit-cq-01', 'validate-changelog', '--check-oops', '--non-interactive', 350067, '--port=mac']" exit_code: 1 cwd: /Volumes/Data/EWS/WebKit

ChangeLog entry in LayoutTests/ChangeLog contains OOPS!.

Full output: https://webkit-queues.webkit.org/results/9270187

[WebKit Commit Bot]

Comment on attachment 350067 [details]
Patch

Clearing flags on attachment: 350067

Committed r236211: <https://trac.webkit.org/changeset/236211>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Radar WebKit Bug Importer]

<rdar://problem/44606920>