Bug 162942

Summary: LayoutTests for contentextensions seem to be very flaky
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED FIXED    
Severity: Normal CC: achristensen, ap, jbedard, jlewis3
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=161732
https://bugs.webkit.org/show_bug.cgi?id=168082
https://bugs.webkit.org/show_bug.cgi?id=168081

Description Ryan Haddad 2016-10-04 15:02:20 PDT
LayoutTests for contentextensions seem to be very flaky

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2F
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcontentextensions%2F

stderr from the tests when they fail:
2016-10-04 14:26:08.235 WebKitTestRunner[25782:45468604] Extension compilation failed: Unspecified error during compile.
Comment 1 Ryan Haddad 2016-10-04 15:03:03 PDT
I'm not sure if each of these tests is flaky for their own reason, or if there is an underlying issue with the compilation of content extensions in general.
Comment 2 Alex Christensen 2016-10-04 15:14:19 PDT
rdar://27788755
Comment 3 Ryan Haddad 2016-10-07 09:38:27 PDT
Marked as flaky in http://trac.webkit.org/projects/webkit/changeset/206914
Comment 4 Ryan Haddad 2017-10-30 11:51:54 PDT
Removed flaky expectation in https://trac.webkit.org/r224194
Comment 5 Matt Lewis 2017-12-13 12:47:29 PST
Talked to Alex about the tests further. Determined that tests should be marked as flaky:

https://trac.webkit.org/changeset/225866/webkit