Bug 163922 - REGRESSION (r207754): LayoutTest http/tests/security/svg-image-with-css-cross-domain.html is a flaky failure
Summary: REGRESSION (r207754): LayoutTest http/tests/security/svg-image-with-css-cross...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords:
: 164029 (view as bug list)
Depends on:
Blocks:
 
Reported: 2016-10-24 16:52 PDT by Ryan Haddad
Modified: 2016-10-29 06:49 PDT (History)
5 users (show)

See Also:


Attachments
Archive of layout-test-results from webkit-cq-01 (984.91 KB, application/zip)
2016-10-27 15:27 PDT, WebKit Commit Bot
no flags Details
Patch (8.56 KB, patch)
2016-10-28 05:49 PDT, youenn fablet
no flags Details | Formatted Diff | Diff
Archive of layout-test-results from ews122 for ios-simulator-wk2 (7.06 MB, application/zip)
2016-10-28 07:19 PDT, Build Bot
no flags Details
Patch (7.65 KB, patch)
2016-10-28 07:23 PDT, youenn fablet
no flags Details | Formatted Diff | Diff
Patch (7.21 KB, patch)
2016-10-28 08:02 PDT, youenn fablet
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Comment 1 Ryan Haddad 2016-10-26 15:20:27 PDT
*** Bug 164029 has been marked as a duplicate of this bug. ***
Comment 2 Ryan Haddad 2016-10-27 09:55:13 PDT
This seems to have started after https://trac.webkit.org/changeset/207754
Comment 3 WebKit Commit Bot 2016-10-27 15:27:32 PDT
The commit-queue just saw http/tests/security/svg-image-with-css-cross-domain.html flake (image diff) while processing attachment 293060 [details] on bug 163995.
Bot: webkit-cq-01  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.10.5
Comment 4 WebKit Commit Bot 2016-10-27 15:27:33 PDT
Created attachment 293068 [details]
Archive of layout-test-results from webkit-cq-01
Comment 5 Ryan Haddad 2016-10-27 16:00:40 PDT
I cannot cleanly revert the change, so I have marked the test as flaky on mac in http://trac.webkit.org/projects/webkit/changeset/208015.

Youenn, could you take a look?
Comment 6 youenn fablet 2016-10-28 03:22:58 PDT
(In reply to comment #5)
> I cannot cleanly revert the change, so I have marked the test as flaky on
> mac in http://trac.webkit.org/projects/webkit/changeset/208015.
> 
> Youenn, could you take a look?

Thanks for spotting it, I'll have a look.
Comment 7 youenn fablet 2016-10-28 05:49:39 PDT
Created attachment 293146 [details]
Patch
Comment 8 Build Bot 2016-10-28 07:19:38 PDT
Comment on attachment 293146 [details]
Patch

Attachment 293146 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/2392635

New failing tests:
http/tests/security/svg-image-with-css-cross-domain.html
Comment 9 Build Bot 2016-10-28 07:19:42 PDT
Created attachment 293152 [details]
Archive of layout-test-results from ews122 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews122  Port: ios-simulator-wk2  Platform: Mac OS X 10.11.6
Comment 10 youenn fablet 2016-10-28 07:22:30 PDT
(In reply to comment #8)
> Comment on attachment 293146 [details]
> Patch
> 
> Attachment 293146 [details] did not pass ios-sim-ews (ios-simulator-wk2):
> Output: http://webkit-queues.webkit.org/results/2392635
> 
> New failing tests:
> http/tests/security/svg-image-with-css-cross-domain.html

Humm... this test was failing previously, sometimes due to 0.03% errors, sometimes to bug fixed in this patch.
It is somehow bad that we are not able to discriminate between the two cases.
I'll update the patch to mark http/tests/security/svg-image-with-css-cross-domain.html as failing on iOS :(
Comment 11 youenn fablet 2016-10-28 07:23:54 PDT
Created attachment 293153 [details]
Patch
Comment 12 youenn fablet 2016-10-28 07:25:10 PDT
(In reply to comment #11)
> Created attachment 293153 [details]
> Patch

Patch no longer contains the change to iOS test expectation, meaning that svg-image-with-css-cross-domain.html is still marked as failing on iOS
Comment 13 youenn fablet 2016-10-28 08:02:32 PDT
Created attachment 293160 [details]
Patch
Comment 14 Alex Christensen 2016-10-28 09:17:32 PDT
Comment on attachment 293153 [details]
Patch

r=me, could you add a similar test for images?
Comment 15 youenn fablet 2016-10-28 10:38:10 PDT
Thanks for the review.

(In reply to comment #14)
> Comment on attachment 293153 [details]
> Patch
> 
> r=me, could you add a similar test for images?

There are some tests doing it already, like for CSS.
The issue was that they were not exercising the use of m_data.

For images, I'll check how m_data is used in CachedImage and see whether I can add a test. Even if m_data is not used now, it may stil be in the future, so the change for CachedImage is good anyway.
Comment 16 WebKit Commit Bot 2016-10-29 06:49:46 PDT
Comment on attachment 293153 [details]
Patch

Clearing flags on attachment: 293153

Committed r208102: <http://trac.webkit.org/changeset/208102>
Comment 17 WebKit Commit Bot 2016-10-29 06:49:50 PDT
All reviewed patches have been landed.  Closing bug.