Bug 190903 – Flaky Test: http/wpt/css/css-animations/start-animation-001.html

• Status: RESOLVED
• Resolution: FIXED
• Component: Animations

[WebKit Commit Bot]

This is an automatically generated bug from the commit-queue.
http/wpt/css/css-animations/start-animation-001.html has been flaky on the commit-queue.

http/wpt/css/css-animations/start-animation-001.html was authored by [e-mail], [e-mail], and [e-mail].
https://trac.webkit.org/browser/trunk/LayoutTests/http/wpt/css/css-animations/start-animation-001.html

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 353084 [details] on bug 190900.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

The bots will update this with information from each new failure.

If you believe this bug to be fixed or invalid, feel free to close.  The bots will re-open if the flake re-occurs.

If you would like to track this test fix with another bug, please close this bug as a duplicate.  The bots will follow the duplicate chain when making future comments.

[WebKit Commit Bot]

Created attachment 353087 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 353362 [details] on bug 191063.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 353477 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 355422 [details] on bug 190836.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 355429 [details]
Archive of layout-test-results from webkit-cq-02

[Ryan Haddad]

The image diff shows an unexpected red square(?) appearing behind a blue rectangle.

[Frédéric Wang (:fredw)]

Yes, unfortunately I guess flakiness is expected for this kind of animation+reftest tests. 

Since bug 186129 was that the blue square did not move at all, the test will still be able to check the bug if we increase the timeout testRunner.notifyDone() to an arbitrarily large value. That will reduce flakiness but probably won't fix it completely.

Per https://bugs.webkit.org/show_bug.cgi?id=186129#c7 we can also rely on the getComputedStyle() to prevent firing the notifyDone() too early and again that will still check for bug 186129.

[Frédéric Wang (:fredw)]

Created attachment 355926 [details]
Patch

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 355987 [details] on bug 192092.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 355993 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356069 [details] on bug 192185.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356079 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356069 [details] on bug 192185.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356089 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356069 [details] on bug 192185.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356093 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356132 [details] on bug 192165.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356146 [details]
Archive of layout-test-results from webkit-cq-03

[Frédéric Wang (:fredw)]

@graouts: Can you please review this patch?

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356502 [details] on bug 192120.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356508 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356679 [details] on bug 189533.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356685 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 356748 [details] on bug 192409.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 356756 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 357543 [details] on bug 191374.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 357547 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 357892 [details] on bug 192952.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 357907 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 357987 [details] on bug 180373.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 357993 [details]
Archive of layout-test-results from webkit-cq-01

[WebKit Commit Bot]

Comment on attachment 355926 [details]
Patch

Clearing flags on attachment: 355926

Committed r239607: <https://trac.webkit.org/changeset/239607>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Radar WebKit Bug Importer]

<rdar://problem/47047434>

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 358323 [details] on bug 193141.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 358326 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 358374 [details] on bug 174980.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 358384 [details]
Archive of layout-test-results from webkit-cq-01

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 358376 [details] on bug 193155.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 358388 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 358374 [details] on bug 174980.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 358389 [details]
Archive of layout-test-results from webkit-cq-01

[Ryan Haddad]

Well, it looks like this test is still frequently failing on EWS bots after https://trac.webkit.org/changeset/239607

[WebKit Commit Bot]

The commit-queue just saw http/wpt/css/css-animations/start-animation-001.html flake (image diff) while processing attachment 358405 [details] on bug 193140.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.12.6

[WebKit Commit Bot]

Created attachment 358414 [details]
Archive of layout-test-results from webkit-cq-01

[Frédéric Wang (:fredw)]

(In reply to Ryan Haddad from comment #43)
> Well, it looks like this test is still frequently failing on EWS bots after
> https://trac.webkit.org/changeset/239607

Yes, it looks even worse now so probably we should revert this.

[Antoine Quint]

This test should not exist anymore.

[Antoine Quint]

Fixed together with https://bugs.webkit.org/show_bug.cgi?id=192895.