Bug 223387

Summary: [ macOS wk2 ] media/track/track-cue-css.html is a flakey Image failure
Product: WebKit Reporter: Robert Jenner <jenner>
Component: MediaAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: eric.carlson, jer.noble, peng.liu6, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Image DIFFS none

Description Robert Jenner 2021-03-17 11:08:09 PDT
media/track/track-cue-css.html

is a flakey image failure in macOS Catalina+ in release and debug, on wk1 an wk2, one Intel and Apple Silicon Macs. 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=media%2Ftrack%2Ftrack-cue-css.html&platform=mac

Image Diffs have been attached to this bug.
Comment 1 Robert Jenner 2021-03-17 11:24:17 PDT
Created attachment 423507 [details]
Image DIFFS

Attaching image diffs to bug.
Comment 2 Radar WebKit Bug Importer 2021-03-17 11:24:47 PDT
<rdar://problem/75535441>
Comment 3 Robert Jenner 2021-03-17 15:32:48 PDT
I was able to reproduce the failure at BigSur Debug ToT using the following test:

run-webkit-test media/track/track-cue-css.html --iterations 1000 --child-process=1

I could not track down a regression point, as it appears this test has been a flakey image failure for a while. But it is reproducible at ToT at least.
Comment 4 Robert Jenner 2021-03-17 15:42:23 PDT
I have updated the test expectations to Pass ImageOnlyFailure to deal with the flakiness of this test while it is being reviewed:
https://trac.webkit.org/changeset/274595/webkit
Comment 5 Eric Carlson 2021-03-22 17:45:15 PDT
It looks like the "actual" results are correct, and the "expected" results incorrect.