Bug 232040

Summary: New test : [ iOS macOS wk2 ] webanimations/marker-opacity-animation-no-effect.html is a flaky image failure
Product: WebKit Reporter: ayumi_kojima
Component: AnimationsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED FIXED    
Severity: Normal CC: ap, bfulgham, dino, don.olmstead, graouts, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=231906
Attachments:
Description Flags
Image diff none

Description ayumi_kojima 2021-10-20 13:53:37 PDT 
webanimations/marker-opacity-animation-no-effect.html

Is a flaky image failure on iOS 15 and macOS wk2.

History: https://results.webkit.org/?suite=layout-tests&test=webanimations%2Fmarker-opacity-animation-no-effect.html

Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r284548%20(6019)/results.html
Comment 1 Radar WebKit Bug Importer 2021-10-20 13:54:09 PDT 
<rdar://problem/84477684>
Comment 2 ayumi_kojima 2021-10-20 13:54:26 PDT 
Created attachment 441930 [details]
Image diff
Comment 3 ayumi_kojima 2021-10-20 13:58:13 PDT 
Marked test expectations https://trac.webkit.org/changeset/284565/webkit
Comment 4 ayumi_kojima 2021-10-20 16:51:40 PDT 
I was able to reproduce the image failure locally using run-webkit-tests --force --iterations 500 --exit-after-n-failures 1 webanimations/marker-opacity-animation-no-effect.html

The test passed with r284515 (though this revision failed on the testing bot) and failed with r284516. 

It looks like https://trac.webkit.org/changeset/284516/webkit caused the flaky image failure, but not sure since I think it is very strange that r284515 failed on the testing bot, but didn't fail locally (iterated 1000 times, but passed.)
Comment 5 Alexey Proskuryakov 2021-10-22 11:21:51 PDT 
Yes, it's very unlikely for r284516 to have caused this.
Comment 6 Alexey Proskuryakov 2021-10-22 11:30:56 PDT 
I think that it's just a coincidence that the test worked for a few build after having been added, and it's just a flaky test.
Comment 7 Brent Fulgham 2022-06-23 14:43:32 PDT 
Ryan and Antoine confirmed this is resolved as of 5/20/2022.