Bug 173726 - REGRESSION LayoutTest animations/play-state-suspend.html is a flaky failure.
Summary: REGRESSION LayoutTest animations/play-state-suspend.html is a flaky failure.
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-06-22 10:51 PDT by Matt Lewis
Modified: 2017-06-26 16:47 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-22 10:51:04 PDT
animations/play-state-suspend.html is a flaky failure.

According to the dashboard it is only currently happening on iOS simulator WK2 Release. The first failure was at 6/20/2017.
https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218620%20(2431)/results.html
https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2431

History:
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=animations%2Fplay-state-suspend.html

Current build:
https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218699%20(2466)/results.html
https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2466

Diff:
--- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/animations/play-state-suspend-expected.txt
+++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/animations/play-state-suspend-actual.txt
@@ -6,6 +6,6 @@
 PASS - "left" property for "box2" element at 0.65s saw something close to: 100
 PASS - "webkitTransform" property for "box1" element at 0.75s saw something close to: 1,0,0,1,100,0
 PASS - "left" property for "box2" element at 0.75s saw something close to: 100
-PASS - "webkitTransform" property for "box1" element at 1s saw something close to: 1,0,0,1,140,0
-PASS - "left" property for "box2" element at 1s saw something close to: 140
+FAIL - "webkitTransform" property for "box1" element at 1s expected: 1,0,0,1,140,0 but saw: matrix(1, 0, 0, 1, 167.70513916015625, 0)
+FAIL - "left" property for "box2" element at 1s expected: 140 but saw: 166.125
 


Currently I have been unable to pinpoint the regression. or reproduce the failure locally.
Comment 1 Matt Lewis 2017-06-26 16:47:49 PDT
Marked the test as flaky on iOS https://trac.webkit.org/changeset/218824/webkit