Bug 155196 - security/contentSecurityPolicy/video-with-blob-url-allowed-by-media-src-star.html and security/contentSecurityPolicy/video-with-data-url-allowed-by-media-src-star.html are flaky
Summary: security/contentSecurityPolicy/video-with-blob-url-allowed-by-media-src-star....
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebCore Misc. (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2016-03-08 14:01 PST by Ryan Haddad
Modified: 2019-06-21 13:30 PDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Comment 1 Ryan Haddad 2016-03-08 17:15:58 PST
At least in this example, it looks like the ACTUAL result is correct, and the EXPECTED result is incorrect for both tests:
<https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK1%20(Tests)/r197819%20(4188)/results.html>
Comment 2 Alexey Proskuryakov 2016-03-09 09:09:07 PST
The tests are super flaky, failing around half of the time. Dan, could you please take a look?

There was one failure on Yosemite too, so this may not be El Capitan specific.
Comment 3 Ryan Haddad 2016-03-09 15:04:02 PST
Dan should be able to look at this shortly. Skipped tests to reduce noise in <http://trac.webkit.org/projects/webkit/changeset/197890>
Comment 4 Daniel Bates 2016-04-28 01:03:51 PDT
Skipped test LayoutTests/media/video-with-file-url-allowed-by-csp-media-src-star-with-AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.html (added in bug #157100) in <https://trac.webkit.org/r200180>
Comment 5 Ryan Haddad 2016-04-28 10:37:49 PDT
(In reply to comment #4)
> Skipped test
> LayoutTests/media/video-with-file-url-allowed-by-csp-media-src-star-with-
> AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.html (added
> in bug #157100) in <https://trac.webkit.org/r200180>

It appears that this test is also flaky on WK2
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-with-file-url-allowed-by-csp-media-src-star-with-AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.html>
Comment 6 Ryan Haddad 2016-04-28 10:58:16 PDT
Moved skip(In reply to comment #5)
> It appears that this test is also flaky on WK2
> <http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.
> html#showAllRuns=true&tests=media%2Fvideo-with-file-url-allowed-by-csp-media-
> src-star-with-AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.
> html>

Moved skip to platform/mac/TestExpectations in <http://trac.webkit.org/projects/webkit/changeset/200199>
Comment 7 Radar WebKit Bug Importer 2016-06-16 14:15:20 PDT
<rdar://problem/26846436>
Comment 8 Ryan Haddad 2016-06-17 14:30:43 PDT
Also skipped security/contentSecurityPolicy/video-with-file-url-allowed-by-media-src-star.html in https://trac.webkit.org/r202180
Comment 9 Alexey Proskuryakov 2016-06-20 13:34:17 PDT
Updated test expectations in <http://trac.webkit.org/r202235>.

Changed from skipping to flaky, because there is no reason to not run these tests, and it's good to have results on the dashboard. Also added one more test from this group, which was making bots red.
Comment 10 Alexey Proskuryakov 2016-06-20 15:31:37 PDT
Skipped security/contentSecurityPolicy/video-with-blob-url-allowed-by-media-src-star.html on WebKit1 only again, because is times out every time.
Comment 11 Russell Epstein 2019-06-21 13:30:20 PDT
security/contentSecurityPolicy/video-with-file-url-allowed-by-media-src-star-with-AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.html appears to be flaky on iOS Simulator as well, with the same diff.