Bug 173565

Summary:	Layout Test media/media-source/media-source-paint-to-canvas.html is flaky
Product:	WebKit	Reporter:	Matt Lewis <jlewis3>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	jer.noble, ryanhaddad
Priority:	P2
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=178083

Description Matt Lewis 2017-06-19 14:28:21 PDT

media/media-source/media-source-paint-to-canvas.html is a flaky failure on macOS El Capitan Release according to the Flakiness Dashboard.

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fmedia-source%2Fmedia-source-paint-to-canvas.html

The first failure was on 6/13/2017
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/builds/2496

First failure:
https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/r218231%20(2496)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/builds/2496

current failure:
https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218503%20(2470)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/builds/2470
The original diff and current Diff are similar but differ slightly

Original Diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk1/build/layout-test-results/media/media-source/media-source-paint-to-canvas-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk1/build/layout-test-results/media/media-source/media-source-paint-to-canvas-actual.txt
@@ -3,7 +3,7 @@
 EVENT(canplay)
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
 EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK



Current Diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/media-source/media-source-paint-to-canvas-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/media-source/media-source-paint-to-canvas-actual.txt
@@ -3,12 +3,12 @@
 EVENT(canplay)
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 END OF TEST

Comment 1 Matt Lewis 2017-06-26 17:26:58 PDT

Marked test as flaky on El Capitan Release:
https://trac.webkit.org/changeset/218825/webkit