Bug 203225

Summary: [ Mac ] Layout Test legacy-animation-engine/compositing/backing/transform-transition-from-outside-view.html is flaky
Product: WebKit Reporter: Truitt Savell <tsavell>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: ap, graouts, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=184611

Description Truitt Savell 2019-10-21 16:51:43 PDT
The following layout test is flaky on Mac

legacy-animation-engine/compositing/backing/transform-transition-from-outside-view.html

Probable cause:

This test is highly flakey on Mac. It has expectations set for wk1 already but has been failing on wk2 as well. Test was introduced in https://trac.webkit.org/changeset/230471/webkit . I am able to reproduce it easily with running it In iterations. I have been unable so far to find a revision that this does not fail on.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=legacy-animation-engine%2Fcompositing%2Fbacking%2Ftransform-transition-from-outside-view.html

Diff:
--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/legacy-animation-engine/compositing/backing/transform-transition-from-outside-view-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/legacy-animation-engine/compositing/backing/transform-transition-from-outside-view-actual.txt
@@ -14,7 +14,7 @@
           (bounds 148.00 128.00)
           (drawsContent 1)
           (backingStoreAttached 1)
-          (transform [1.00 0.00 0.00 0.00] [0.00 1.00 0.00 0.00] [0.00 0.00 1.00 0.00] [-400.00 0.00 0.00 1.00])
+          (transform [1.00 0.00 0.00 0.00] [0.00 1.00 0.00 0.00] [0.00 0.00 1.00 0.00] [-399.99 0.00 0.00 1.00])
           (children 1
             (GraphicsLayer
               (offsetFromRenderer width=-14 height=-14)
Comment 1 Radar WebKit Bug Importer 2019-10-21 16:52:09 PDT
<rdar://problem/56482469>
Comment 2 Truitt Savell 2019-10-21 16:57:13 PDT
marked test as failing while investigating https://trac.webkit.org/changeset/251398/webkit
Comment 3 Alexey Proskuryakov 2019-10-23 15:34:08 PDT
Is this the same as bug 184611?
Comment 4 Truitt Savell 2019-10-23 16:01:29 PDT
The diff is very different between these now o I don't think I would consider them the same.
Comment 5 Antoine Quint 2019-10-24 01:50:17 PDT
I think Alexey is right, the flakiness reported was before the fix for bug 184611 landed.
Comment 6 Alexey Proskuryakov 2019-10-24 08:48:44 PDT
There were no failures since the fix for bug 184611 landed, so this is either a dupe or something that got fixed even earlier. Marking R/CC because there is no need to investigate which.
Comment 7 Truitt Savell 2019-10-24 09:13:39 PDT
Removed expectation for this test in https://trac.webkit.org/changeset/251541/webkit