Bug 206667 - [iOS] legacy-animation-engine/animations/stop-animation-on-suspend.html is a flaky failure
Summary: [iOS] legacy-animation-engine/animations/stop-animation-on-suspend.html is a ...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Animations (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-01-23 09:25 PST by Jason Lawrence
Modified: 2020-03-09 12:57 PDT (History)
5 users (show)

See Also:

Attachments
Update Test Expectations (1.43 KB, patch)
2020-01-27 14:10 PST, Jason Lawrence 		no flags Details | Formatted Diff | Diff
Update Test Expectations (1.43 KB, patch)
2020-01-27 14:27 PST, Jason Lawrence 		no flags Details | Formatted Diff | Diff
Show Obsolete (2) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-01-23 09:25:03 PST 
legacy-animation-engine/animations/stop-animation-on-suspend.html

Description:
This test is flaky failing on iOS release.

History:
https://results.webkit.org/?suite=layout-tests&test=legacy-animation-engine%2Fanimations%2Fstop-animation-on-suspend.html

Diff:
--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/legacy-animation-engine/animations/stop-animation-on-suspend-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/legacy-animation-engine/animations/stop-animation-on-suspend-actual.txt
@@ -1,6 +1,6 @@
 
 PASS - "webkitTransform" property for "box" element at 0.2s saw something close to: 1,0,0,1,100,0
 PASS - "webkitTransform" property for "iframe.subframe-box" element at 0.2s saw something close to: 1,0,0,1,100,0
-PASS - "webkitTransform" property for "box" element at 0.4s saw something close to: 1,0,0,1,200,0
-PASS - "webkitTransform" property for "iframe.subframe-box" element at 0.4s saw something close to: 1,0,0,1,200,0
+FAIL - "webkitTransform" property for "box" element at 0.4s expected: 1,0,0,1,200,0 but saw: matrix(1, 0, 0, 1, 126.72084045410156, 0)
+FAIL - "webkitTransform" property for "iframe.subframe-box" element at 0.4s expected: 1,0,0,1,200,0 but saw: matrix(1, 0, 0, 1, 126.85371398925781, 0)
Comment 1 Alexey Proskuryakov 2020-01-24 22:58:30 PST 
This test is marked as flaky on macOS, see bug 49182. It is curious that failures are most common on iOS Release, but scrolling back in history, I see them on debug too.

This is not a new regression.
Comment 2 Jason Lawrence 2020-01-27 14:10:53 PST 
Created attachment 388907 [details]
Update Test Expectations
Comment 3 Jason Lawrence 2020-01-27 14:27:06 PST 
Created attachment 388911 [details]
Update Test Expectations
Comment 4 Truitt Savell 2020-01-27 14:29:28 PST 
Comment on attachment 388911 [details]
Update Test Expectations

Clearing flags on attachment: 388911

Committed r255177: <https://trac.webkit.org/changeset/255177>
Comment 5 Jason Lawrence 2020-01-28 14:36:30 PST 
I was able to reproduce this issue locally by running the following command: ’run-webkit-tests legacy-animation-engine/animations/stop-animation-on-suspend.html --iterations 5000 -f --ios-simulator’
4994 tested ran as expected, 6 didn’t.
Comment 6 Antoine Quint 2020-03-09 12:56:20 PDT 
This test is gone as of r258150, see bug 208815.
Comment 7 Radar WebKit Bug Importer 2020-03-09 12:57:15 PDT 
<rdar://problem/60238048>