Bug 208519 – REGRESSION (r257756?) [ Catalina ] webanimations/accelerated-animation-slot-invalidation.html is flaky failing.

• Status: RESOLVED
• Resolution: INVALID
• Component: Animations

[Jason Lawrence]

Created attachment 392286 [details]
accelerated-animation-slot-invalidation-diff

webanimations/accelerated-animation-slot-invalidation.html

Description:
This test is flaky failing on Catalina. The oldest failure that I see is on r257025, but I am not able to locate a diff for that failure.

History:
https://results.webkit.org/?suite=layout-tests&test=webanimations%2Faccelerated-animation-slot-invalidation.html&platform=mac&version_name=Catalina&style=debug&style=release

Diff:
https://build.webkit.org/results/Apple-Catalina-Debug-WK1-Tests/r257778%20(2849)/webanimations/accelerated-animation-slot-invalidation-diff.png

[Radar WebKit Bug Importer]

<rdar://problem/59999868>

[Radar WebKit Bug Importer]

<rdar://problem/60000347>

[Jason Lawrence]

I have marked this as failing the image test while this issue is investigated.
https://trac.webkit.org/changeset/257782/webkit

[Radar WebKit Bug Importer]

<rdar://problem/60000486>

[Jason Lawrence]

I can reproduce this issue on r257778 by running the command below.
run-webkit-tests --iterations 2000 --exit-after-n-failures 3 --force webanimations/accelerated-animation-slot-invalidation.html

[1/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92312])
[2/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92565])
[3/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92742])
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (1997 didn't run):

[Jason Lawrence]

when using the same command, I can see that the issue starts between r257759 & r257747.

r257759:
[1/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39617])
[2/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39633])
[3/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39649])
Exiting early after 3 failures. 3 tests run.
0 tests ran as expected, 3 didn't (997 didn't run):

r257747:
All 1000 tests ran as expected.

[Jason Lawrence]

Correction. I was not able to reproduce the failures, I could not locate a diff on the results page and did not get a crash log locally. 
There does appear to be an issue that's likely related to r257756.

[Jason Lawrence]

Marking as invalid and creating a new bug, if needed