Bug 223387 - [ macOS wk2 ] media/track/track-cue-css.html is a flakey Image failure
Summary: [ macOS wk2 ] media/track/track-cue-css.html is a flakey Image failure
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-03-17 11:08 PDT by Robert Jenner
Modified: 2021-03-22 17:45 PDT (History)
5 users (show)

See Also:

Attachments
Image DIFFS (60.45 KB, application/zip)
2021-03-17 11:24 PDT, Robert Jenner 		no flags Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-03-17 11:08:09 PDT 
media/track/track-cue-css.html

is a flakey image failure in macOS Catalina+ in release and debug, on wk1 an wk2, one Intel and Apple Silicon Macs. 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=media%2Ftrack%2Ftrack-cue-css.html&platform=mac

Image Diffs have been attached to this bug.
Comment 1 Robert Jenner 2021-03-17 11:24:17 PDT 
Created attachment 423507 [details]
Image DIFFS

Attaching image diffs to bug.
Comment 2 Radar WebKit Bug Importer 2021-03-17 11:24:47 PDT 
<rdar://problem/75535441>
Comment 3 Robert Jenner 2021-03-17 15:32:48 PDT 
I was able to reproduce the failure at BigSur Debug ToT using the following test:

run-webkit-test media/track/track-cue-css.html --iterations 1000 --child-process=1

I could not track down a regression point, as it appears this test has been a flakey image failure for a while. But it is reproducible at ToT at least.
Comment 4 Robert Jenner 2021-03-17 15:42:23 PDT 
I have updated the test expectations to Pass ImageOnlyFailure to deal with the flakiness of this test while it is being reviewed:
https://trac.webkit.org/changeset/274595/webkit
Comment 5 Eric Carlson 2021-03-22 17:45:15 PDT 
It looks like the "actual" results are correct, and the "expected" results incorrect.