Summary: | Flaky Test: animations/play-state-suspend.html | ||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Product: | WebKit | Reporter: | WebKit Commit Bot <commit-queue> | ||||||||||||||||||||||
Component: | Tools / Tests | Assignee: | WebKit Commit Bot <commit-queue> | ||||||||||||||||||||||
Status: | NEW --- | ||||||||||||||||||||||||
Severity: | Normal | CC: | cmarrin, dino, eric, jparent | ||||||||||||||||||||||
Priority: | P2 | ||||||||||||||||||||||||
Version: | 528+ (Nightly build) | ||||||||||||||||||||||||
Hardware: | Other | ||||||||||||||||||||||||
OS: | OS X 10.5 | ||||||||||||||||||||||||
See Also: | https://bugs.webkit.org/show_bug.cgi?id=173726 | ||||||||||||||||||||||||
Bug Depends on: | |||||||||||||||||||||||||
Bug Blocks: | 50856 | ||||||||||||||||||||||||
Attachments: |
|
Description
WebKit Commit Bot
2010-12-13 12:38:14 PST
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 75771 [details] on bug 50607. Bot: eseidel-sf Port: Mac Platform: Mac OS X 10.6.4 The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 75707 [details] on bug 50571. Bot: eseidel-sf Port: Mac Platform: Mac OS X 10.6.4 The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77006 [details] on bug 51338. Bot: eseidel-cq-sf Port: Mac Platform: Mac OS X 10.6.4 Created attachment 77020 [details]
Failure diff from bot
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77026 [details] on bug 51347. Bot: eseidel-cq-sf Port: Mac Platform: Mac OS X 10.6.4 Created attachment 77037 [details]
Failure diff from bot
The commit-queue just saw animations/play-state-suspend.html flake while processing attachment 77090 [details] on bug 51272. Bot: eseidel-cq-sf Port: Mac Platform: Mac OS X 10.6.4 Created attachment 77096 [details]
Failure diff from eseidel-cq-sf
Interesting that this is a recent failure, and only so far on eseidel-sf. The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 80721 [details] on bug 53476. Bot: cr-jail-8 Port: Mac Platform: Mac OS X 10.6.6 Created attachment 80749 [details]
Failure diff from cr-jail-8
Do these results just need to be made more permissive? @jparent: Long ago you spoke of having a better way to run/write these tests. I'm wondering if that ever go anywhere? We have pretty good evidence that this test flakes regularly. Obviously more when machines are slowed down (eseidel-cq-sf used to be running many bots). Seems we should either skip the test or find some other fix. @eseidel I do intend to get back to this work soon. I'm leaving on vacation for a few days tomorrow, but it will be one of the things I do upon returning. The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 81365 [details] on bug 53847. Bot: cr-jail-8 Port: Mac Platform: Mac OS X 10.6.6 Created attachment 81370 [details]
Failure diff from cr-jail-8
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 83234 [details] on bug 54914. Bot: cr-jail-3 Port: Mac Platform: Mac OS X 10.6.6 Created attachment 83249 [details]
Failure diff from cr-jail-3
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 83977 [details] on bug 55322. Bot: cr-jail-3 Port: Mac Platform: Mac OS X 10.6.6 Created attachment 83982 [details]
Failure diff from cr-jail-3
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 84566 [details] on bug 55677. Bot: cr-jail-7 Port: Mac Platform: Mac OS X 10.6.6 Created attachment 84582 [details]
Failure diff from cr-jail-7
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 89025 [details] on bug 50373. Bot: eseidel-cq-sf Port: Mac Platform: Mac OS X 10.6.4 Created attachment 89046 [details]
Failure diff from eseidel-cq-sf
The commit-queue just saw animations/play-state-suspend.html flake (Text diff mismatch) while processing attachment 95759 [details] on bug 54417. Bot: cr-jail-7 Port: Mac Platform: Mac OS X 10.6.7 Created attachment 96266 [details]
Failure diff from cr-jail-7
This test has become a _lot_ more flaky last week (see also bug 128379). It fails roughly 50% of the time. First failure was in r163476. Sample failure: @@ -1,11 +1,11 @@ This test makes sure a play-state change in an animation during suspend does not resume the animation. -PASS - "webkitTransform" property for "box1" element at 0.55s saw something close to: 1,0,0,1,100,0 -PASS - "left" property for "box2" element at 0.55s saw something close to: 100 -PASS - "webkitTransform" property for "box1" element at 0.65s saw something close to: 1,0,0,1,100,0 -PASS - "left" property for "box2" element at 0.65s saw something close to: 100 -PASS - "webkitTransform" property for "box1" element at 0.75s saw something close to: 1,0,0,1,100,0 -PASS - "left" property for "box2" element at 0.75s saw something close to: 100 -PASS - "webkitTransform" property for "box1" element at 1s saw something close to: 1,0,0,1,140,0 +FAIL - "webkitTransform" property for "box1" element at 0.55s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0) +FAIL - "left" property for "box2" element at 0.55s expected: 100 but saw: 121.15300750732422 +FAIL - "webkitTransform" property for "box1" element at 0.65s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0) +FAIL - "left" property for "box2" element at 0.65s expected: 100 but saw: 121.15300750732422 +FAIL - "webkitTransform" property for "box1" element at 0.75s expected: 1,0,0,1,100,0 but saw: matrix(1, 0, 0, 1, 121.15300750732422, 0) +FAIL - "left" property for "box2" element at 0.75s expected: 100 but saw: 121.15300750732422 +FAIL - "webkitTransform" property for "box1" element at 1s expected: 1,0,0,1,140,0 but saw: matrix(1, 0, 0, 1, 161.10345458984375, 0) PASS - "left" property for "box2" element at 1s saw something close to: 140 Marked as flaky in <http://trac.webkit.org/r163819>. |