Bug 208077

Summary: [ Mac Debug ] legacy-animation-engine/animations/animation-welcome-safari.html is flaky failing.
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: AnimationsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: dino, graouts, graouts, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Mac   
OS: macOS 10.15   

Description Jason Lawrence 2020-02-21 16:07:08 PST
legacy-animation-engine/animations/animation-welcome-safari.html

Description:
This test is flaky failing on Mac Debug. The test has been flaky failing throughout the visible history, the oldest test that I am able to load (r254553) has the same diff.

History:
https://results.webkit.org/?suite=layout-tests&test=legacy-animation-engine%2Fanimations%2Fanimation-welcome-safari.html&platform=mac&style=debug

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/legacy-animation-engine/animations/animation-welcome-safari-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/legacy-animation-engine/animations/animation-welcome-safari-actual.txt
@@ -1 +1 @@
-PASS start of the animation
+FAIL start of the animation
Comment 1 Radar WebKit Bug Importer 2020-02-21 16:11:03 PST
<rdar://problem/59687072>
Comment 2 Jason Lawrence 2020-02-21 16:17:20 PST
I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/257181/webkit
Comment 3 Jason Lawrence 2020-02-24 17:00:22 PST
I was able to reproduce this issue on r257181 (debug) by running multiple instances (4) of this test:
run-webkit-tests legacy-animation-engine/animations/animation-welcome-safari.html --iterations 4000 --exit-after-n-failures 5 --force --platform mac-mojave --debug -g
[19/4000] legacy-animation-engine/animations/animation-welcome-safari.html failed unexpectedly (text diff)
[22/4000] legacy-animation-engine/animations/animation-welcome-safari.html failed unexpectedly (text diff)
Retrying 1 unexpected failure ...
Running 1 WebKitTestRunner.
3998 tests ran as expected, 2 didn't:

Diff:
...layout-test-results/legacy-animation-engine/animations/animation-welcome-safari-actual.txt
@@ -1 +1 @@
-PASS start of the animation
+FAIL start of the animation
Comment 4 Antoine Quint 2020-03-09 12:55:15 PDT
This test is gone as of r258150, see bug 208815.