Bug 146400

Summary: http/tests/contentextensions/character-set-basic-support.html is flaky on mac-wk2
Product: WebKit Reporter: David Kilzer (:ddkilzer) <ddkilzer>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: achristensen, ap, beidson
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: Unspecified   
OS: Unspecified   

Description David Kilzer (:ddkilzer) 2015-06-28 15:45:33 PDT
The http/tests/contentextensions/character-set-basic-support.html test is flaky on mac-wk2:

<http://webkit-test-results.appspot.com/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcontentextensions%2Fcharacter-set-basic-support.html>

It appears that the failures occur when either the first subtest gets the opposite of the expected result:

-URL: http://127.0.0.1:8000/resources/square100.png is not blocked.
-PASS isBlocked is false
+URL: http://127.0.0.1:8000/resources/square100.png is blocked.
+FAIL isBlocked should be false. Was true.

Or the last subtest result is simply missing:

 PASS isBlocked is true
-URL: http://127.0.0.1:8000/resources/square100.png?caseSeNsitive is blocked.
-PASS isBlocked is true
 PASS successfullyParsed is true
Comment 1 David Kilzer (:ddkilzer) 2015-06-28 15:55:52 PDT
Marked test as flaky:
Commit r186055:  <http://trac.webkit.org/changeset/186055>
Comment 2 Alex Christensen 2015-06-29 10:14:14 PDT
I think this is WebKitTestRunner not resetting state properly, but I'm not sure.