animations/play-state-suspend.html is a flaky failure. According to the dashboard it is only currently happening on iOS simulator WK2 Release. The first failure was at 6/20/2017. https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218620%20(2431)/results.html https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2431 History: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=animations%2Fplay-state-suspend.html Current build: https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218699%20(2466)/results.html https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2466 Diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/animations/play-state-suspend-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/animations/play-state-suspend-actual.txt @@ -6,6 +6,6 @@ PASS - "left" property for "box2" element at 0.65s saw something close to: 100 PASS - "webkitTransform" property for "box1" element at 0.75s saw something close to: 1,0,0,1,100,0 PASS - "left" property for "box2" element at 0.75s saw something close to: 100 -PASS - "webkitTransform" property for "box1" element at 1s saw something close to: 1,0,0,1,140,0 -PASS - "left" property for "box2" element at 1s saw something close to: 140 +FAIL - "webkitTransform" property for "box1" element at 1s expected: 1,0,0,1,140,0 but saw: matrix(1, 0, 0, 1, 167.70513916015625, 0) +FAIL - "left" property for "box2" element at 1s expected: 140 but saw: 166.125 Currently I have been unable to pinpoint the regression. or reproduce the failure locally.
Marked the test as flaky on iOS https://trac.webkit.org/changeset/218824/webkit