Bug 181565

Summary: LayoutTests imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html and mediasource-config-change-mp4-v-framesize.html are flaky on EWS
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: MediaAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: commit-queue, jer.noble, jlewis3
Priority: P2    
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=181669
Description Flags
Archive of layout-test-results from webkit-cq-01 none

Description Ryan Haddad 2018-01-11 16:16:29 PST
LayoutTest imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html is a flaky failure on EWS

See https://bugs.webkit.org/show_bug.cgi?id=168447#c50

--- /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-actual.txt
@@ -1,3 +1,5 @@
-PASS Tests mp4 video-only frame size changes. 
+Harness Error (TIMEOUT), message = null
+TIMEOUT Tests mp4 video-only frame size changes. Test timed out
Comment 1 Ryan Haddad 2018-01-11 16:20:49 PST
Also flaked here https://webkit-queues.webkit.org/results/6041686
Comment 2 Ryan Haddad 2018-01-11 18:04:28 PST
Just realized that I pasted a diff from a different test: imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html

Both flaked on the same patch here https://bugs.webkit.org/show_bug.cgi?id=168447

Here is the very similar diff for mediasource-config-change-mp4-v-bitrate.html
--- /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-actual.txt
@@ -1,3 +1,5 @@
-PASS Tests mp4 video-only bitrate changes. 
+Harness Error (TIMEOUT), message = null
+TIMEOUT Tests mp4 video-only bitrate changes. Test timed out
Comment 3 Ryan Haddad 2018-01-11 18:21:09 PST
These tests don't seem to be failing on the non-EWS bots. I haven't dug in to this yet, but there is a hardware difference between the general test machines (Mac mini) and EWS (Mac Pro).
Comment 4 Alexey Proskuryakov 2018-01-12 10:24:00 PST
*** Bug 181571 has been marked as a duplicate of this bug. ***
Comment 6 WebKit Commit Bot 2018-01-19 10:33:23 PST
The commit-queue just saw imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html flake (text diff) while processing attachment 331744 [details] on bug 179670.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6
Comment 7 WebKit Commit Bot 2018-01-19 10:33:24 PST
Created attachment 331750 [details]
Archive of layout-test-results from webkit-cq-01
Comment 8 Ryan Haddad 2018-01-19 16:17:16 PST
Marked tests as flaky in https://trac.webkit.org/r227249 to help EWS.