Bug 228087

Summary: [ iOS Debug & Mac wk2 ] media/video-seek-with-negative-playback.html is a flaky failure.
Product: WebKit Reporter: Eric Hutchison <ehutchison>
Component: MediaAssignee: Eric Carlson <eric.carlson>
Status: NEW ---    
Severity: Normal CC: ayumi_kojima, ehutchison, eric.carlson, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Update Test Expectations
none
Test List none

Description Eric Hutchison 2021-07-19 13:38:14 PDT 
media/video-seek-with-negative-playback.html

is a flaky failure on Mac wk2.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Fvideo-seek-with-negative-playback.html&platform=mac&platform=ios

Diff: --- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-actual.txt
@@ -5,6 +5,6 @@
 EVENT(seeked)
 EVENT(timeupdate)
 EVENT(timeupdate)
-EXPECTED (video.currentTime < '3') OK
+EXPECTED (video.currentTime < '3'), OBSERVED '3' FAIL
 END OF TEST

r278498 appears to be first instance of failure.

reproduced on r280024 with run-webkit-tests --debug -f --iterations 500 --exit-after-n-failures 2 media/video-seek-with-negative-playback.html
Comment 1 Radar WebKit Bug Importer 2021-07-19 13:38:43 PDT 
<rdar://problem/80800402>
Comment 2 Eric Hutchison 2021-07-19 14:01:42 PDT 
Created attachment 433822 [details]
Update Test Expectations
Comment 3 Truitt Savell 2021-07-19 14:54:24 PDT 
Comment on attachment 433822 [details]
Update Test Expectations

Clearing flags on attachment: 433822

Committed r280048 (239783@main): <https://commits.webkit.org/239783@main>
Comment 4 Eric Hutchison 2021-07-19 15:39:15 PDT 
Created attachment 433829 [details]
Test List

unable to reproduce with attached test list using run-webkit-tests -f --test-list= (Test List)
Comment 5 ayumi_kojima 2021-09-17 11:18:30 PDT 
The test is now flaky timing out/failing on iOS Debug and macOS wk2. 

Diff (Timeout):

--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-actual.txt
@@ -1,10 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+
 
 Test that seeking with a negative playbackRate works correctly.
 
 EVENT(canplaythrough)
 EVENT(seeked)
-EVENT(timeupdate)
-EVENT(timeupdate)
-EXPECTED (video.currentTime < '3') OK
-END OF TEST
Comment 6 ayumi_kojima 2021-09-17 11:23:09 PDT 
Updated test expectations: https://trac.webkit.org/changeset/282675/webkit