Bug 248062 - REGRESSION: [iOS] imported/w3c/web-platform-tests/webcodecs/full-cycle-test.https.any.html?h264_avc is a flaky failure
Summary: REGRESSION: [iOS] imported/w3c/web-platform-tests/webcodecs/full-cycle-test.h...
Status: REOPENED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-11-17 15:58 PST by Ryan Haddad
Modified: 2023-06-27 04:08 PDT (History)
3 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2022-11-17 15:58:47 PST 
imported/w3c/web-platform-tests/webcodecs/full-cycle-test.https.any.html?h264_avc is a flaky failure on iOS

--- /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-arm64-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/webcodecs/full-cycle-test.https.any_h264_avc-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-arm64-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/webcodecs/full-cycle-test.https.any_h264_avc-actual.txt
@@ -1,3 +1,7 @@
+CONSOLE MESSAGE: Error: assert_equals: decode timestamp expected 4 but got 5
+CONSOLE MESSAGE: Error: assert_equals: decode timestamp expected 5 but got 4
 
-PASS Encoding and decoding cycle
+Harness Error (FAIL), message = Error: assert_equals: decode timestamp expected 5 but got 4
 
+FAIL Encoding and decoding cycle assert_equals: frames_decoded expected 16 but got 14
+

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebcodecs%2Ffull-cycle-test.https.any.html%3Fh264_avc
Comment 1 Ryan Haddad 2022-11-17 16:02:18 PST 
This test was consistently passing up until https://commits.webkit.org/255615@main, at which point it started consistently failing.

After https://commits.webkit.org/255786@main, the results switched to a flaky failure.
Comment 2 Radar WebKit Bug Importer 2022-11-17 16:02:40 PST 
<rdar://problem/102490465>
Comment 3 Ryan Haddad 2022-11-17 16:05:31 PST 
Pull request: https://github.com/WebKit/WebKit/pull/6611
Comment 4 EWS 2022-11-17 16:09:05 PST 
Test gardening commit 256809@main (f17c70d06276): <https://commits.webkit.org/256809@main>

Reviewed commits have been landed. Closing PR #6611 and removing active labels.
Comment 5 youenn fablet 2023-06-05 04:30:21 PDT 
Pull request: https://github.com/WebKit/WebKit/pull/14667
Comment 6 EWS 2023-06-05 06:33:54 PDT 
Committed 264867@main (8f03a1368380): <https://commits.webkit.org/264867@main>

Reviewed commits have been landed. Closing PR #14667 and removing active labels.
Comment 7 youenn fablet 2023-06-27 04:08:19 PDT 
There are actually still some flakinesses now.
https://bugs.webkit.org/show_bug.cgi?id=258553 might help.