Bug 69279 - allow failure of most Chromium-Mac-Skia tests while we clean up that port
Summary: allow failure of most Chromium-Mac-Skia tests while we clean up that port
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: epoger
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-10-03 12:18 PDT by epoger
Modified: 2011-10-04 07:44 PDT (History)
3 users (show)

See Also:


Attachments
Patch (2.62 KB, patch)
2011-10-03 13:47 PDT, epoger
no flags Details | Formatted Diff | Diff
Patch (2.26 KB, patch)
2011-10-03 14:25 PDT, epoger
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description epoger 2011-10-03 12:18:52 PDT
caryclark and epoger are hard at work getting the Chromium-Mac-Skia port stable. This will make the test results unstable for a while.  Disabling most tests of this port so as not to distract Webkit Gardeners with excess noise (as happened in https://bugs.webkit.org/show_bug.cgi?id=69166 )
Comment 1 epoger 2011-10-03 13:47:11 PDT
Created attachment 109524 [details]
Patch
Comment 2 epoger 2011-10-03 13:49:31 PDT
I have confirmed locally that this would have hidden all layout test failures caused by the CL in https://bugs.webkit.org/show_bug.cgi?id=69166 .

After it passes the trybots, I will request review from a human...
Comment 3 Adam Barth 2011-10-03 14:14:40 PDT
Comment on attachment 109524 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=109524&action=review

What about LEOPARD?  Probably all these SNOWLEOPARDs should just be MAC.

> LayoutTests/platform/chromium/test_expectations.txt:3699
> +BUGWK69279 SNOWLEOPARD CPU : media = PASS TEXT IMAGE IMAGE+TEXT CRASH

No GPU here?

> LayoutTests/platform/chromium/test_expectations.txt:3706
> +BUGWK69279 SNOWLEOPARD CPU GPU : transitions = PASS TEXT IMAGE IMAGE+TEXT CRASH

I think "TEXT IMAGE IMAGE+TEXT" and all be combined into FAIL.
Comment 4 Adam Barth 2011-10-03 14:15:51 PDT
> I think "TEXT IMAGE IMAGE+TEXT" and all be combined into FAIL.

Actually, CRASH is covered too.  You can just mark these as PASS FAIL.  (I'm happy to take another look at this patch if you'd like me to before you land it.)
Comment 5 epoger 2011-10-03 14:25:44 PDT
Created attachment 109531 [details]
Patch
Comment 6 epoger 2011-10-03 14:26:55 PDT
Comment on attachment 109524 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=109524&action=review

>> LayoutTests/platform/chromium/test_expectations.txt:3699
>> +BUGWK69279 SNOWLEOPARD CPU : media = PASS TEXT IMAGE IMAGE+TEXT CRASH
> 
> No GPU here?

Added.  (Previously, I was mindlessly copying from the Leopard section above)

>> LayoutTests/platform/chromium/test_expectations.txt:3706
>> +BUGWK69279 SNOWLEOPARD CPU GPU : transitions = PASS TEXT IMAGE IMAGE+TEXT CRASH
> 
> I think "TEXT IMAGE IMAGE+TEXT" and all be combined into FAIL.

Done.
Comment 7 epoger 2011-10-03 14:27:34 PDT
(In reply to comment #3)
> (From update of attachment 109524 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=109524&action=review
> 
> What about LEOPARD?  Probably all these SNOWLEOPARDs should just be MAC.

I'd like to keep the LEOPARD and SNOWLEOPARD sections separate if that's OK with you.  (I think we can turn them back on at different times.)
Comment 8 Adam Barth 2011-10-03 14:30:07 PDT
Comment on attachment 109531 [details]
Patch

Looks great.
Comment 9 Adam Barth 2011-10-03 15:00:11 PDT
Comment on attachment 109531 [details]
Patch

I don't understand.  If you make a change that causes these tests to fail on both LEOPARD and SNOWLEOPARD, the SNOWLEOPARD bot will stay green but the LEOPARD bot will go red.  Is that what you intend?
Comment 10 epoger 2011-10-04 06:40:22 PDT
(In reply to comment #9)
> (From update of attachment 109531 [details])
> I don't understand.  If you make a change that causes these tests to fail on both LEOPARD and SNOWLEOPARD, the SNOWLEOPARD bot will stay green but the LEOPARD bot will go red.  Is that what you intend?

There is already a section of the test_expectations file that deals with the LEOPARD tests, allowing most of them to fail for now.
Comment 11 WebKit Review Bot 2011-10-04 07:44:45 PDT
Comment on attachment 109531 [details]
Patch

Clearing flags on attachment: 109531

Committed r96592: <http://trac.webkit.org/changeset/96592>
Comment 12 WebKit Review Bot 2011-10-04 07:44:49 PDT
All reviewed patches have been landed.  Closing bug.