Bug 181565 - LayoutTests imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html and mediasource-config-change-mp4-v-framesize.html are flaky on EWS
Summary: LayoutTests imported/w3c/web-platform-tests/media-source/mediasource-config-c...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
: 181571 (view as bug list)
Depends on:
Reported: 2018-01-11 16:16 PST by Ryan Haddad
Modified: 2018-01-19 16:17 PST (History)
3 users (show)

See Also:

Archive of layout-test-results from webkit-cq-01 (2.20 MB, application/zip)
2018-01-19 10:33 PST, WebKit Commit Bot
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2018-01-11 16:16:29 PST
LayoutTest imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html is a flaky failure on EWS

See https://bugs.webkit.org/show_bug.cgi?id=168447#c50

--- /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-actual.txt
@@ -1,3 +1,5 @@
-PASS Tests mp4 video-only frame size changes. 
+Harness Error (TIMEOUT), message = null
+TIMEOUT Tests mp4 video-only frame size changes. Test timed out
Comment 1 Ryan Haddad 2018-01-11 16:20:49 PST
Also flaked here https://webkit-queues.webkit.org/results/6041686
Comment 2 Ryan Haddad 2018-01-11 18:04:28 PST
Just realized that I pasted a diff from a different test: imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html

Both flaked on the same patch here https://bugs.webkit.org/show_bug.cgi?id=168447

Here is the very similar diff for mediasource-config-change-mp4-v-bitrate.html
--- /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-actual.txt
@@ -1,3 +1,5 @@
-PASS Tests mp4 video-only bitrate changes. 
+Harness Error (TIMEOUT), message = null
+TIMEOUT Tests mp4 video-only bitrate changes. Test timed out
Comment 3 Ryan Haddad 2018-01-11 18:21:09 PST
These tests don't seem to be failing on the non-EWS bots. I haven't dug in to this yet, but there is a hardware difference between the general test machines (Mac mini) and EWS (Mac Pro).
Comment 4 Alexey Proskuryakov 2018-01-12 10:24:00 PST
*** Bug 181571 has been marked as a duplicate of this bug. ***
Comment 6 WebKit Commit Bot 2018-01-19 10:33:23 PST
The commit-queue just saw imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html flake (text diff) while processing attachment 331744 [details] on bug 179670.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6
Comment 7 WebKit Commit Bot 2018-01-19 10:33:24 PST
Created attachment 331750 [details]
Archive of layout-test-results from webkit-cq-01
Comment 8 Ryan Haddad 2018-01-19 16:17:16 PST
Marked tests as flaky in https://trac.webkit.org/r227249 to help EWS.