Bug 173565 - Layout Test media/media-source/media-source-paint-to-canvas.html is flaky
Summary: Layout Test media/media-source/media-source-paint-to-canvas.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-06-19 14:28 PDT by Matt Lewis
Modified: 2017-10-09 08:57 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-19 14:28:21 PDT
media/media-source/media-source-paint-to-canvas.html is a flaky failure on macOS El Capitan Release according to the Flakiness Dashboard.

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fmedia-source%2Fmedia-source-paint-to-canvas.html

The first failure was on 6/13/2017
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/builds/2496

First failure:
https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/r218231%20(2496)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/builds/2496

current failure:
https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218503%20(2470)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/builds/2470
The original diff and current Diff are similar but differ slightly

Original Diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk1/build/layout-test-results/media/media-source/media-source-paint-to-canvas-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk1/build/layout-test-results/media/media-source/media-source-paint-to-canvas-actual.txt
@@ -3,7 +3,7 @@
 EVENT(canplay)
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
 EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK



Current Diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/media-source/media-source-paint-to-canvas-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/media-source/media-source-paint-to-canvas-actual.txt
@@ -3,12 +3,12 @@
 EVENT(canplay)
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 RUN(video.currentTime += 1.001 / 24)
 EVENT(seeked)
-EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0') OK
+EXPECTED (canvas.getContext("2d").getImageData(250, 130, 1, 1).data[0] != '0'), OBSERVED '0' FAIL
 END OF TEST
Comment 1 Matt Lewis 2017-06-26 17:26:58 PDT
Marked test as flaky on El Capitan Release:
https://trac.webkit.org/changeset/218825/webkit