Bug 245710 - REGRESSION (247947@main?): [ iOS ] media/video-played-reset.html is a flaky failure
Summary: REGRESSION (247947@main?): [ iOS ] media/video-played-reset.html is a flaky f...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-09-26 17:24 PDT by Karl Rackler
Modified: 2024-04-18 23:27 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-09-26 17:24:40 PDT
Description:
media/video-played-reset.html

The first failure I saw on the dashboard was on 3/1/2022 at 247951@main.  There was a media change at 247947@main that could have possibly caused the regression.

Reproduction steps:
I can reproduce this on 254878@main ToT.

Command: 
run-webkit-tests --ios-simulator --debug --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 --no-retry media/video-played-reset.html

Result: 
Unexpected flakiness: text-only failures
  media/video-played-reset.html [ Pass Failure ]

History:
https://results.webkit.org/?suite=layout-tests&test=media%2Fvideo-played-reset.html&platform=ios&limit=50000

Diff:
--- /Volumes/Data/worker/Apple-iOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/media/video-played-reset-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/media/video-played-reset-actual.txt
@@ -27,7 +27,7 @@
 EVENT(pause)
 Test 6 OK
 Test 7 OK
-Test 8 OK
+EXPECTED (video.played.end(0).toFixed(2) == '5.65'), OBSERVED '5.64' FAIL
 
 Test to reset to an empty video source
 RUN(video.src = "")H
Comment 1 Radar WebKit Bug Importer 2022-09-26 17:25:02 PDT
<rdar://problem/100435297>
Comment 2 Karl Rackler 2022-09-26 17:29:18 PDT
I have marked this test as a flaky failure while this issue is investigated.
Comment 3 EWS 2022-09-26 17:43:41 PDT
Test gardening commit 254884@main (291fada448af): <https://commits.webkit.org/254884@main>

Reviewed commits have been landed. Closing PR #4730 and removing active labels.
Comment 4 Jean-Yves Avenard [:jya] 2024-04-18 23:27:58 PDT
fixed by bug 238771