Bug 181565

Summary:

LayoutTests imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html and mediasource-config-change-mp4-v-framesize.html are flaky on EWS

Product:

WebKit

Reporter:

Ryan Haddad <ryanhaddad>

Component:

Media

Assignee:

Nobody <webkit-unassigned>

Status:

NEW ---

Severity:

Normal

CC:

commit-queue, jer.noble, jlewis3

Priority:

Version:

Other

Hardware:

Unspecified

OS:

Unspecified

See Also:

https://bugs.webkit.org/show_bug.cgi?id=181669
https://bugs.webkit.org/show_bug.cgi?id=181717
https://bugs.webkit.org/show_bug.cgi?id=181718

Attachments:

Description	Flags
Archive of layout-test-results from webkit-cq-01	none

Description Ryan Haddad 2018-01-11 16:16:29 PST

LayoutTest imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate.html is a flaky failure on EWS

See https://bugs.webkit.org/show_bug.cgi?id=168447#c50

--- /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Debug/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Tests mp4 video-only frame size changes. 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Tests mp4 video-only frame size changes. Test timed out
+

Comment 1 Ryan Haddad 2018-01-11 16:20:49 PST

Also flaked here https://webkit-queues.webkit.org/results/6041686

Comment 2 Ryan Haddad 2018-01-11 18:04:28 PST

Just realized that I pasted a diff from a different test: imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html

Both flaked on the same patch here https://bugs.webkit.org/show_bug.cgi?id=168447

Here is the very similar diff for mediasource-config-change-mp4-v-bitrate.html
--- /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-expected.txt
+++ /Volumes/Data/EWS/WebKit/WebKitBuild/Release/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-bitrate-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Tests mp4 video-only bitrate changes. 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Tests mp4 video-only bitrate changes. Test timed out
+

Comment 3 Ryan Haddad 2018-01-11 18:21:09 PST

These tests don't seem to be failing on the non-EWS bots. I haven't dug in to this yet, but there is a hardware difference between the general test machines (Mac mini) and EWS (Mac Pro).

Comment 4 Alexey Proskuryakov 2018-01-12 10:24:00 PST

*** Bug 181571 has been marked as a duplicate of this bug. ***

Comment 5 Ryan Haddad 2018-01-17 10:10:41 PST

Flakiness dashboard results for these tests:
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-config-change-mp4

Comment 6 WebKit Commit Bot 2018-01-19 10:33:23 PST

The commit-queue just saw imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-v-framesize.html flake (text diff) while processing attachment 331744 [details] on bug 179670.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

Comment 7 WebKit Commit Bot 2018-01-19 10:33:24 PST

Created attachment 331750 [details]
Archive of layout-test-results from webkit-cq-01

Comment 8 Ryan Haddad 2018-01-19 16:17:16 PST

Marked tests as flaky in https://trac.webkit.org/r227249 to help EWS.