Bug 50959 - Flaky Test: animations/play-state-suspend.html
Summary: Flaky Test: animations/play-state-suspend.html
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Other OS X 10.5
: P2 Normal
Assignee: WebKit Commit Bot
URL:
Keywords:
Depends on:
Blocks: 50856
  Show dependency treegraph
 
Reported: 2010-12-13 12:38 PST by WebKit Commit Bot
Modified: 2017-06-26 15:17 PDT (History)
4 users (show)

See Also:


Attachments
Failure diff from bot (1.74 KB, text/plain)
2010-12-20 11:47 PST, WebKit Commit Bot
no flags Details
Failure diff from bot (1.82 KB, text/plain)
2010-12-20 14:32 PST, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (1.82 KB, text/plain)
2010-12-21 01:38 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (1.82 KB, text/plain)
2011-02-01 05:36 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (1.82 KB, text/plain)
2011-02-05 12:20 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-3 (864 bytes, text/plain)
2011-02-21 18:06 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-3 (1.86 KB, text/plain)
2011-02-27 11:37 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-7 (1.81 KB, text/plain)
2011-03-03 10:34 PST, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (1.87 KB, text/plain)
2011-04-11 12:11 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-7 (862 bytes, text/plain)
2011-06-07 11:27 PDT, WebKit Commit Bot
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description WebKit Commit Bot 2010-12-13 12:38:14 PST
This is an automatically generated bug from the commit-queue.
animations/play-state-suspend.html has been flaky on the commit-queue.

animations/play-state-suspend.html was authored by cmarrin@apple.com.
http://trac.webkit.org/browser/trunk/LayoutTests/animations/play-state-suspend.html

The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 75493 [details] on bug 50456.
Bot: eseidel-sf  Port: Mac  Platform: Mac OS X 10.6.4

The bots will update this with information from each new failure.

If you would like to track this test fix with another bug, please close this bug as a duplicate.
Comment 1 WebKit Commit Bot 2010-12-14 03:43:16 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 75771 [details] on bug 50607.
Bot: eseidel-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 2 WebKit Commit Bot 2010-12-14 04:47:30 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 75707 [details] on bug 50571.
Bot: eseidel-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 3 WebKit Commit Bot 2010-12-20 11:47:56 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77006 [details] on bug 51338.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 4 WebKit Commit Bot 2010-12-20 11:47:58 PST
Created attachment 77020 [details]
Failure diff from bot
Comment 5 WebKit Commit Bot 2010-12-20 14:32:56 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77026 [details] on bug 51347.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 6 WebKit Commit Bot 2010-12-20 14:32:58 PST
Created attachment 77037 [details]
Failure diff from bot
Comment 7 WebKit Commit Bot 2010-12-21 01:38:13 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77090 [details] on bug 51272.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 8 WebKit Commit Bot 2010-12-21 01:38:15 PST
Created attachment 77096 [details]
Failure diff from eseidel-cq-sf
Comment 9 Eric Seidel (no email) 2010-12-23 00:21:08 PST
Interesting that this is a recent failure, and only so far on eseidel-sf.
Comment 10 WebKit Commit Bot 2011-02-01 05:36:08 PST
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 80721 [details] on bug 53476.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 11 WebKit Commit Bot 2011-02-01 05:36:11 PST
Created attachment 80749 [details]
Failure diff from cr-jail-8
Comment 12 Eric Seidel (no email) 2011-02-01 12:38:45 PST
Do these results just need to be made more permissive?

@jparent:  Long ago you spoke of having a better way to run/write these tests.  I'm wondering if that ever go anywhere?
Comment 13 Eric Seidel (no email) 2011-02-01 12:40:09 PST
We have pretty good evidence that this test flakes regularly.  Obviously more when machines are slowed down (eseidel-cq-sf used to be running many bots).  Seems we should either skip the test or find some other fix.
Comment 14 Julie Parent 2011-02-01 19:43:14 PST
@eseidel
I do intend to get back to this work soon.  I'm leaving on vacation for a few days tomorrow, but it will be one of the things I do upon returning.
Comment 15 WebKit Commit Bot 2011-02-05 12:20:39 PST
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 81365 [details] on bug 53847.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 16 WebKit Commit Bot 2011-02-05 12:20:42 PST
Created attachment 81370 [details]
Failure diff from cr-jail-8
Comment 17 WebKit Commit Bot 2011-02-21 18:06:09 PST
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 83234 [details] on bug 54914.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.6
Comment 18 WebKit Commit Bot 2011-02-21 18:06:12 PST
Created attachment 83249 [details]
Failure diff from cr-jail-3
Comment 19 WebKit Commit Bot 2011-02-27 11:37:21 PST
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 83977 [details] on bug 55322.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.6
Comment 20 WebKit Commit Bot 2011-02-27 11:37:25 PST
Created attachment 83982 [details]
Failure diff from cr-jail-3
Comment 21 WebKit Commit Bot 2011-03-03 10:34:33 PST
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 84566 [details] on bug 55677.
Bot: cr-jail-7  Port: Mac  Platform: Mac OS X 10.6.6
Comment 22 WebKit Commit Bot 2011-03-03 10:34:36 PST
Created attachment 84582 [details]
Failure diff from cr-jail-7
Comment 23 WebKit Commit Bot 2011-04-11 12:11:04 PDT
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 89025 [details] on bug 50373.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 24 WebKit Commit Bot 2011-04-11 12:11:06 PDT
Created attachment 89046 [details]
Failure diff from eseidel-cq-sf
Comment 25 WebKit Commit Bot 2011-06-07 11:27:40 PDT
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 95759 [details] on bug 54417.
Bot: cr-jail-7  Port: Mac  Platform: Mac OS X 10.6.7
Comment 26 WebKit Commit Bot 2011-06-07 11:27:44 PDT
Created attachment 96266 [details]
Failure diff from cr-jail-7
Comment 27 Alexey Proskuryakov 2014-02-10 14:18:25 PST
This test has become a _lot_ more flaky last week (see also bug 128379). It fails roughly 50% of the time.

First failure was in r163476. Sample failure:

@@ -1,11 +1,11 @@
 This test makes sure a play-state change in an animation during suspend does not resume the animation.
 
-PASS - "webkitTransform" property for "box1" element at 0.55s saw something close to: 1,0,0,1,100,0
-PASS - "left" property for "box2" element at 0.55s saw something close to: 100
-PASS - "webkitTransform" property for "box1" element at 0.65s saw something close to: 1,0,0,1,100,0
-PASS - "left" property for "box2" element at 0.65s saw something close to: 100
-PASS - "webkitTransform" property for "box1" element at 0.75s saw something close to: 1,0,0,1,100,0
-PASS - "left" property for "box2" element at 0.75s saw something close to: 100
-PASS - "webkitTransform" property for "box1" element at 1s saw something close to: 1,0,0,1,140,0
+FAIL - "webkitTransform" property for "box1" element at 0.55s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0)
+FAIL - "left" property for "box2" element at 0.55s expected: 100 but saw: 121.15300750732422
+FAIL - "webkitTransform" property for "box1" element at 0.65s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0)
+FAIL - "left" property for "box2" element at 0.65s expected: 100 but saw: 121.15300750732422
+FAIL - "webkitTransform" property for "box1" element at 0.75s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0)
+FAIL - "left" property for "box2" element at 0.75s expected: 100 but saw: 121.15300750732422
+FAIL - "webkitTransform" property for "box1" element at 1s expected: 1,0,0,1,140,0 but saw: matrix(1, 0, 0, 1, 161.10345458984375, 0)
 PASS - "left" property for "box2" element at 1s saw something close to: 140
Comment 28 Alexey Proskuryakov 2014-02-10 14:19:41 PST
Marked as flaky in <http://trac.webkit.org/r163819>.