Bug 64394 – cr-linux-ews should run pixel tests

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Adam Barth]

cr-linux-ews should run pixel tests

[Adam Barth]

Created attachment 100564 [details]
Patch

[Ojan Vafai]

Comment on attachment 100564 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=100564&action=review

> Tools/ChangeLog:9
> +        test on the bots, it looks like we have five pixel failures, related to

I'm confused, won't these 5 tests start failing on every run now?

> Tools/ChangeLog:11
> +        avoid uploading huge zip files to bugs.webkit.org (with all the exected

typo:exected

[Adam Barth]

(In reply to comment #2)
> (From update of attachment 100564 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=100564&action=review
> 
> > Tools/ChangeLog:9
> > +        test on the bots, it looks like we have five pixel failures, related to
> 
> I'm confused, won't these 5 tests start failing on every run now?

Yes, but we have code to recognize persistent failures and ignore them.

[Ojan Vafai]

Comment on attachment 100564 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=100564&action=review

>>> Tools/ChangeLog:9
>>> +        test on the bots, it looks like we have five pixel failures, related to
>> 
>> I'm confused, won't these 5 tests start failing on every run now?
> 
> Yes, but we have code to recognize persistent failures and ignore them.

That sounds scary.

[Adam Barth]

(In reply to comment #4)
> (From update of attachment 100564 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=100564&action=review
> 
> >>> Tools/ChangeLog:9
> >>> +        test on the bots, it looks like we have five pixel failures, related to
> >> 
> >> I'm confused, won't these 5 tests start failing on every run now?
> > 
> > Yes, but we have code to recognize persistent failures and ignore them.
> 
> That sounds scary.

There's an upper bound on how many failures to ignore.  It's been working for us so far.  If it causes problems, we can re-evaluate later.

[WebKit Review Bot]

Comment on attachment 100564 [details]
Patch

Clearing flags on attachment: 100564

Committed r90864: <http://trac.webkit.org/changeset/90864>

[WebKit Review Bot]

All reviewed patches have been landed.  Closing bug.