Bug 139472 - Mac test expectations gardening
Summary: Mac test expectations gardening
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Alexey Proskuryakov
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-12-10 00:21 PST by Alexey Proskuryakov
Modified: 2014-12-11 00:52 PST (History)
3 users (show)

See Also:


Attachments
the patch (37.77 KB, patch)
2014-12-10 00:22 PST, Alexey Proskuryakov
buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from ews100 for mac-mountainlion (692.48 KB, application/zip)
2014-12-10 01:06 PST, Build Bot
no flags Details
Archive of layout-test-results from ews104 for mac-mountainlion-wk2 (717.81 KB, application/zip)
2014-12-10 01:06 PST, Build Bot
no flags Details
try again (38.70 KB, patch)
2014-12-10 10:17 PST, Alexey Proskuryakov
buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from webkit-ews-12 for mac-mountainlion-wk2 (509.22 KB, application/zip)
2014-12-10 11:28 PST, Build Bot
no flags Details
try again (22.28 KB, patch)
2014-12-10 21:09 PST, Alexey Proskuryakov
buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from ews103 for mac-mountainlion (504.94 KB, application/zip)
2014-12-10 21:54 PST, Build Bot
no flags Details
Archive of layout-test-results from ews107 for mac-mountainlion-wk2 (577.84 KB, application/zip)
2014-12-10 21:58 PST, Build Bot
no flags Details
try again (23.36 KB, patch)
2014-12-10 22:43 PST, Alexey Proskuryakov
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Alexey Proskuryakov 2014-12-10 00:21:40 PST
Would like to run through EWS before landing.
Comment 1 Alexey Proskuryakov 2014-12-10 00:22:10 PST
Created attachment 242992 [details]
the patch
Comment 2 Build Bot 2014-12-10 01:06:06 PST
Comment on attachment 242992 [details]
the patch

Attachment 242992 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/6323685862408192

New failing tests:
fast/canvas/canvas-draw-canvas-on-canvas-shadow.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba4444.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-array-buffer-view.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba5551.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgb565.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data.html
canvas/philip/tests/2d.gradient.interpolate.colouralpha.html
Comment 3 Build Bot 2014-12-10 01:06:09 PST
Created attachment 242995 [details]
Archive of layout-test-results from ews100 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews100  Port: mac-mountainlion  Platform: Mac OS X 10.8.5
Comment 4 Build Bot 2014-12-10 01:06:54 PST
Comment on attachment 242992 [details]
the patch

Attachment 242992 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5725547443257344

New failing tests:
fast/canvas/canvas-draw-canvas-on-canvas-shadow.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba4444.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-array-buffer-view.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba5551.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgb565.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data.html
canvas/philip/tests/2d.gradient.interpolate.colouralpha.html
Comment 5 Build Bot 2014-12-10 01:06:57 PST
Created attachment 242996 [details]
Archive of layout-test-results from ews104 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 6 Alexey Proskuryakov 2014-12-10 10:16:47 PST
This looks like more ATI-only bugginess, will mark these tests again, but just on 10.8. We can see later it this affects other OS versions.
Comment 7 Alexey Proskuryakov 2014-12-10 10:17:03 PST
Created attachment 243043 [details]
try again
Comment 8 Alexey Proskuryakov 2014-12-10 11:26:54 PST
Looks like unskipping causes flakiness on other tests, I'll need to do this in smaller chunks.
Comment 9 Build Bot 2014-12-10 11:28:32 PST
Comment on attachment 243043 [details]
try again

Attachment 243043 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5589553209409536

New failing tests:
fast/canvas/canvas-fillRect-gradient-shadow.html
Comment 10 Build Bot 2014-12-10 11:28:34 PST
Created attachment 243052 [details]
Archive of layout-test-results from webkit-ews-12 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-12  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 11 Alexey Proskuryakov 2014-12-10 21:09:36 PST
Created attachment 243097 [details]
try again
Comment 12 Build Bot 2014-12-10 21:54:51 PST
Comment on attachment 243097 [details]
try again

Attachment 243097 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/5004199901265920

New failing tests:
canvas/philip/tests/2d.gradient.interpolate.colouralpha.html
Comment 13 Build Bot 2014-12-10 21:54:54 PST
Created attachment 243100 [details]
Archive of layout-test-results from ews103 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews103  Port: mac-mountainlion  Platform: Mac OS X 10.8.5
Comment 14 Build Bot 2014-12-10 21:58:14 PST
Comment on attachment 243097 [details]
try again

Attachment 243097 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/6193962750574592

New failing tests:
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba5551.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-array-buffer-view.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgba4444.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data-rgb565.html
fast/canvas/webgl/tex-image-and-sub-image-2d-with-image-data.html
canvas/philip/tests/2d.gradient.interpolate.colouralpha.html
Comment 15 Build Bot 2014-12-10 21:58:16 PST
Created attachment 243101 [details]
Archive of layout-test-results from ews107 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 16 Alexey Proskuryakov 2014-12-10 22:43:24 PST
Created attachment 243106 [details]
try again

Good, these tests used to be marked as failing. Must be another ATI specific failure that we don't see on regular bots.
Comment 17 Alexey Proskuryakov 2014-12-11 00:52:08 PST
Committed r177140.