Bug 69624 - [chromium] Rebaseline layout test zoom-animator-scale-test2.html for win, mac
Summary: [chromium] Rebaseline layout test zoom-animator-scale-test2.html for win, mac
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Layout and Rendering (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: W. James MacLean
URL:
Keywords:
Depends on: 68035
Blocks:
  Show dependency treegraph
 
Reported: 2011-10-07 06:56 PDT by W. James MacLean
Modified: 2011-10-19 19:05 PDT (History)
3 users (show)

See Also:


Attachments
Patch (4.16 KB, patch)
2011-10-13 13:56 PDT, W. James MacLean
no flags Details | Formatted Diff | Diff
Patch (4.16 KB, patch)
2011-10-14 08:36 PDT, W. James MacLean
no flags Details | Formatted Diff | Diff
Patch (2.35 KB, patch)
2011-10-19 11:57 PDT, W. James MacLean
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description W. James MacLean 2011-10-07 06:56:18 PDT
When https://bugs.webkit.org/show_bug.cgi?id=68035 lands, will need baselines for the new test on win and mac. These can be taken off the bots.
Comment 2 W. James MacLean 2011-10-13 13:56:23 PDT
Created attachment 110902 [details]
Patch
Comment 3 Kenneth Russell 2011-10-13 14:09:22 PDT
Comment on attachment 110902 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review

> LayoutTests/platform/chromium/test_expectations.txt:2717
> +BUGWK69624 WIN GPU : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE

Did you intend to leave the GPU modifier here given that the new baseline you're providing is for chromium-gpu-win? You may well have; just confirming.
Comment 4 W. James MacLean 2011-10-13 14:15:09 PDT
(In reply to comment #3)
> (From update of attachment 110902 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review
> 
> > LayoutTests/platform/chromium/test_expectations.txt:2717
> > +BUGWK69624 WIN GPU : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE
> 
> Did you intend to leave the GPU modifier here given that the new baseline you're providing is for chromium-gpu-win? You may well have; just confirming.

Yes, as (strangely) the test is passing on Win WebKit Dbg(2) but not on Win GPU, Win7 GPU and Vista GPU, so I'm still experimenting a bit.
Comment 5 Kent Tamura 2011-10-13 19:39:06 PDT
Comment on attachment 110902 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review

> LayoutTests/platform/chromium/test_expectations.txt:2718
> +BUGWK70046 SKIP MAC : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE+TEXT

Do not skip a valid test. SKIP means buildbots don't produce results.
Comment 6 W. James MacLean 2011-10-14 05:28:16 PDT
(In reply to comment #5)
> (From update of attachment 110902 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review
> 
> > LayoutTests/platform/chromium/test_expectations.txt:2718
> > +BUGWK70046 SKIP MAC : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE+TEXT
> 
> Do not skip a valid test. SKIP means buildbots don't produce results.

But this isn't a valid test for Mac, not until someone undertakes the work described in https://bugs.webkit.org/show_bug.cgi?id=70046 to add zoom animation to ScrollAnimatorChromiumMac. Until then we know the test will always fail, so is it worth running it?
Comment 7 Kent Tamura 2011-10-14 08:01:35 PDT
Comment on attachment 110902 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review

>>> LayoutTests/platform/chromium/test_expectations.txt:2718
>>> +BUGWK70046 SKIP MAC : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE+TEXT
>> 
>> Do not skip a valid test. SKIP means buildbots don't produce results.
> 
> But this isn't a valid test for Mac, not until someone undertakes the work described in https://bugs.webkit.org/show_bug.cgi?id=70046 to add zoom animation to ScrollAnimatorChromiumMac. Until then we know the test will always fail, so is it worth running it?

Running this test on Mac is helpful.  Now we expect IMAGE+TEXT, and it means the test doesn't crash. We would find a regression If this test crashed.
Comment 8 W. James MacLean 2011-10-14 08:36:57 PDT
Created attachment 111017 [details]
Patch
Comment 9 W. James MacLean 2011-10-14 10:04:37 PDT
(In reply to comment #7)
> (From update of attachment 110902 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=110902&action=review
> 
> >>> LayoutTests/platform/chromium/test_expectations.txt:2718
> >>> +BUGWK70046 SKIP MAC : platform/chromium/compositing/zoom-animator-scale-test2.html = IMAGE+TEXT
> >> 
> >> Do not skip a valid test. SKIP means buildbots don't produce results.
> > 
> > But this isn't a valid test for Mac, not until someone undertakes the work described in https://bugs.webkit.org/show_bug.cgi?id=70046 to add zoom animation to ScrollAnimatorChromiumMac. Until then we know the test will always fail, so is it worth running it?
> 
> Running this test on Mac is helpful.  Now we expect IMAGE+TEXT, and it means the test doesn't crash. We would find a regression If this test crashed.

Ahh, understood. Have revised accordingly.
Comment 10 WebKit Review Bot 2011-10-16 23:28:38 PDT
Comment on attachment 111017 [details]
Patch

Clearing flags on attachment: 111017

Committed r97588: <http://trac.webkit.org/changeset/97588>
Comment 11 WebKit Review Bot 2011-10-16 23:28:42 PDT
All reviewed patches have been landed.  Closing bug.
Comment 12 W. James MacLean 2011-10-19 11:57:32 PDT
Created attachment 111655 [details]
Patch
Comment 13 W. James MacLean 2011-10-19 12:00:45 PDT
This test is still flaky on WIN GPU (although better than before, when it was 100% fail). I've marked the test as SLOW since longest runtimes are getting up in the 5+ second range, and I've modified the internal timeout to be longer.

I've re-built Chrome on a Win 7 machine, and found this test passes 100% of the time on a dedicated machine, so I suspect it's an issue with the bots running the test slowly.

Once we get the test more stable, we can experiment with decreasing times if desired.
Comment 14 Kenneth Russell 2011-10-19 12:14:17 PDT
Comment on attachment 111655 [details]
Patch

OK. In general though it's better to file a new bug than reuse an existing one for tracking purposes.
Comment 15 W. James MacLean 2011-10-19 12:15:21 PDT
(In reply to comment #14)
> (From update of attachment 111655 [details])
> OK. In general though it's better to file a new bug than reuse an existing one for tracking purposes.

Thanks, will file a new bug next time.
Comment 16 WebKit Review Bot 2011-10-19 19:05:21 PDT
Comment on attachment 111655 [details]
Patch

Clearing flags on attachment: 111655

Committed r97916: <http://trac.webkit.org/changeset/97916>
Comment 17 WebKit Review Bot 2011-10-19 19:05:26 PDT
All reviewed patches have been landed.  Closing bug.