230411 2021-09-17 10:36:19 -0700 [ macOS ] http/tests/media/hls/video-controller-getStartDate.html is flaky failing 2021-10-14 14:43:23 -0700 1 1 1 Unclassified WebKit Media WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned eric.carlson pvollan webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1794495 0 ayumi_kojima 2021-09-17 10:36:19 -0700 http/tests/media/hls/video-controller-getStartDate.html Is flaky failing on macOS (mainly on wk2, but there are some failures on BigSur wk1 debug as well). History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fhls%2Fvideo-controller-getStartDate.html Result page: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r282087%20(16157)/results.html Diff: --- /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/http/tests/media/hls/video-controller-getStartDate-expected.txt +++ /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/http/tests/media/hls/video-controller-getStartDate-actual.txt @@ -4,6 +4,6 @@ EVENT(canplaythrough) EVENT(canplaythrough) EXPECTED (isNaN(video.getStartDate()) == 'true') OK -EXPECTED (video.getStartDate().toUTCString() == 'Wed, 03 Nov 2010 08:00:00 GMT') OK +EXPECTED (video.getStartDate().toUTCString() == 'Wed, 03 Nov 2010 08:00:00 GMT'), OBSERVED 'Invalid Date' FAIL END OF TEST 1794498 1 webkit-bug-importer 2021-09-17 10:38:43 -0700 <rdar://problem/83246841> 1794499 2 ayumi_kojima 2021-09-17 10:45:06 -0700 Marked test expectations: https://trac.webkit.org/changeset/282670/webkit 1794639 3 ayumi_kojima 2021-09-17 15:18:44 -0700 Tried both on Release and Debug, but I was not able to reproduce the failure using run-webkit-tests --iterations 500 --force http/tests/media/hls/video-controller-getStartDate.html. 1794641 4 ayumi_kojima 2021-09-17 15:28:18 -0700 I was actually able to reproduce the failure with -f flag. 1804521 5 ayumi_kojima 2021-10-14 14:40:37 -0700 I tried bisecting again and found that I couldn't reproduce the failure with the revision that I was able to reproduce before (r281960). I was still able to reproduce the failure with TOT. The test has been flaky for long time, but it looks like it became more flaky recently. That might be why. I was able to reproduce the failure with r283204 but it passed with r283199. (No revisions in between). It looks like https://trac.webkit.org/changeset/283204/webkit caused the test to be more flaky.