LayoutTest media/W3C/video/events/event_progress_manual.html is a flaky failure https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r222647%20(4820)/results.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2FW3C%2Fvideo%2Fevents%2Fevent_progress_manual.html --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/W3C/video/events/event_progress_manual-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/media/W3C/video/events/event_progress_manual-actual.txt @@ -6,6 +6,9 @@ PASS true is true TEST COMPLETE +PASS true is true + +TEST COMPLETE spec reference
It is quite weird that this test prints completion lines twice. It must manage to dispatch the progress event before HTML finishes loading, which is why the first notifyDone() call doesn't work. Also, super weird that we have a non-local URL here (http://media.w3.org/2010/05/video/movie_300?...). Loading it is blocked in DRT and WKTR, so I'm not sure if the test is even testing what it's supposed to. Jer, Eric, what's the best way to avoid flakiness here? Perhaps we don't need this test at all, and can delete it?
This is still happening: https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/r228293%20(2835)/results.html https://build.webkit.org/builders/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/builds/2835 The Dif is still the same. The platforms that the flak happens on is the macOS platform.
Marked as flaky in https://trac.webkit.org/changeset/228300/webkit/
Test has been failing on WK1 builds as well. Mojave WK1 Release just started showing in the last few days, but it's reproducible with older revisions that High Sierra and Mojave WK1 Debug. It is causing failures on EWS. https://bugs.webkit.org/show_bug.cgi?id=196929 Same diff as before.
Updated test expectations for all of Mac in https://trac.webkit.org/changeset/244344/webkit
*** Bug 196929 has been marked as a duplicate of this bug. ***
This test case will fail when the video element fires more than one "progress" event before the test case complete. *** This bug has been marked as a duplicate of bug 181966 ***