Bug 207337 – http/wpt/css/css-animations/start-animation-001.html is flaky failing

• Status: RESOLVED
• Resolution: FIXED
• Component: Animations

[Jason Lawrence]

http/wpt/css/css-animations/start-animation-001.html

Description:
This test is flaky failing on Mac wk1. It possibly regressed when r255131 was rolled out with r255150.

History:
https://results.webkit.org/?suite=layout-tests&test=http%2Fwpt%2Fcss%2Fcss-animations%2Fstart-animation-001.html&platform=mac&flavor=wk1&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Debug-WK1-Tests/r255910%20(2297)/http/wpt/css/css-animations/start-animation-001-diff.png

[Jason Lawrence]

Created attachment 389967 [details]
Update Test Expectations

[Jason Lawrence]

Created attachment 389968 [details]
Update Test Expectations

[Radar WebKit Bug Importer]

<rdar://problem/59226371>

[Jason Lawrence]

I am not able to reproduce this issue with iterations, test-list, debug or Guard Malloc.

[Truitt Savell]

Landed proper expectations in https://trac.webkit.org/changeset/255979/webkit

[Alexey Proskuryakov]

> This test is flaky failing on Mac wk1. It possibly regressed when r255131 was rolled out with r255150.

There were no failures on wk1 between r254153 and r255154, so I don't see evidence for this claim. Also, it fails on wk2 too, including in this range.

[Jacob Uphoff]

I can reproduce this by running the test in iterations x5000 ( failed 18 times )

[Jacob Uphoff]

Set proper expectations here: https://trac.webkit.org/changeset/256506/webkit

[Antoine Quint]

Created attachment 393759 [details]
Patch

[Antoine Quint]

Committed r258572: <https://trac.webkit.org/changeset/258572>

[Aakash Jain]

(In reply to Antoine Quint from comment #10)
> Committed r258572: <https://trac.webkit.org/changeset/258572>
It seems like http/wpt/css/css-animations/start-animation-001.html is failing on Windows EWS since this change. Can you have a look?
e.g.: https://ews-build.webkit.org/results/Windows-EWS/r394076-12243-clean-tree/results.html

[Antoine Quint]

(In reply to Aakash Jain from comment #11)
> (In reply to Antoine Quint from comment #10)
> > Committed r258572: <https://trac.webkit.org/changeset/258572>
> It seems like http/wpt/css/css-animations/start-animation-001.html is
> failing on Windows EWS since this change. Can you have a look?
> e.g.:
> https://ews-build.webkit.org/results/Windows-EWS/r394076-12243-clean-tree/
> results.html

While I've definitely seen that failure on Windows EWS bots, I cannot see it in our results database, https://results.webkit.org/?suite=layout-tests&test=http%2Fwpt%2Fcss%2Fcss-animations%2Fstart-animation-001.html.

[Antoine Quint]

Tracking this failure in https://bugs.webkit.org/show_bug.cgi?id=209426.