Bug 228087 - [ iOS Debug & Mac wk2 ] media/video-seek-with-negative-playback.html is a flaky failure.
Summary: [ iOS Debug & Mac wk2 ] media/video-seek-with-negative-playback.html is a fla...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Eric Carlson
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-07-19 13:38 PDT by Eric Hutchison
Modified: 2021-09-17 11:23 PDT (History)
6 users (show)

See Also:

Attachments
Update Test Expectations (2.39 KB, patch)
2021-07-19 14:01 PDT, Eric Hutchison 		no flags Details | Formatted Diff | Diff
Test List (585.93 KB, text/plain)
2021-07-19 15:39 PDT, Eric Hutchison 		no flags Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Eric Hutchison 2021-07-19 13:38:14 PDT 
media/video-seek-with-negative-playback.html

is a flaky failure on Mac wk2.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Fvideo-seek-with-negative-playback.html&platform=mac&platform=ios

Diff: --- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-actual.txt
@@ -5,6 +5,6 @@
 EVENT(seeked)
 EVENT(timeupdate)
 EVENT(timeupdate)
-EXPECTED (video.currentTime < '3') OK
+EXPECTED (video.currentTime < '3'), OBSERVED '3' FAIL
 END OF TEST

r278498 appears to be first instance of failure.

reproduced on r280024 with run-webkit-tests --debug -f --iterations 500 --exit-after-n-failures 2 media/video-seek-with-negative-playback.html
Comment 1 Radar WebKit Bug Importer 2021-07-19 13:38:43 PDT 
<rdar://problem/80800402>
Comment 2 Eric Hutchison 2021-07-19 14:01:42 PDT 
Created attachment 433822 [details]
Update Test Expectations
Comment 3 Truitt Savell 2021-07-19 14:54:24 PDT 
Comment on attachment 433822 [details]
Update Test Expectations

Clearing flags on attachment: 433822

Committed r280048 (239783@main): <https://commits.webkit.org/239783@main>
Comment 4 Eric Hutchison 2021-07-19 15:39:15 PDT 
Created attachment 433829 [details]
Test List

unable to reproduce with attached test list using run-webkit-tests -f --test-list= (Test List)
Comment 5 ayumi_kojima 2021-09-17 11:18:30 PDT 
The test is now flaky timing out/failing on iOS Debug and macOS wk2. 

Diff (Timeout):

--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/video-seek-with-negative-playback-actual.txt
@@ -1,10 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+
 
 Test that seeking with a negative playbackRate works correctly.
 
 EVENT(canplaythrough)
 EVENT(seeked)
-EVENT(timeupdate)
-EVENT(timeupdate)
-EXPECTED (video.currentTime < '3') OK
-END OF TEST
Comment 6 ayumi_kojima 2021-09-17 11:23:09 PDT 
Updated test expectations: https://trac.webkit.org/changeset/282675/webkit