As seen on this test run, http/tests/websocket/tests/hybi/contentextensions/block-cookies.php and http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker.php are flaky failures on El Capitan and Yosemite Release WK2 https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205581%20(9262)/results.html http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies-worker.php http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies.php --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-actual.txt @@ -3,7 +3,7 @@ On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". worker WebSocket open -PASS worker WebSocket message (no cookies) +PASS worker WebSocket message (cookie:WK-websocket-test-httponly=1) PASS successfullyParsed is true TEST COMPLETE --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-actual.txt @@ -3,7 +3,7 @@ On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". WebSocket open -WebSocket message (no cookies) +WebSocket message (cookie:WK-websocket-test-httponly=1) PASS successfullyParsed is true TEST COMPLETE
These tests became very flaky ~5 days ago.
This run had even more of the tests in this directory failing https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205743%20(9312)/results.html http/tests/websocket/tests/hybi/contentextensions/block-cookies.php [ Failure ] http/tests/websocket/tests/hybi/contentextensions/block-worker.html [ Failure ] http/tests/websocket/tests/hybi/contentextensions/block.html [ Failure ] http/tests/websocket/tests/hybi/contentextensions/display-none-worker.html [ Failure ] http/tests/websocket/tests/hybi/contentextensions/display-none.html [ Failure ]
strange
I saw one of these flakes a few weeks ago.
Another failing run: https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20%28Tests%29/builds/9400 From stderr: 2016-09-13 14:08:49.902 WebKitTestRunner[52473:61400357] Extension compilation failed: Unspecified error during compile.
rdar://27788755