Bug 161732 – REGRESSION: LayoutTests http/tests/websocket/tests/hybi/contentextensions/block-cookies* are flaky failures

• Status: NEW
• Component: New Bugs

[Ryan Haddad]

As seen on this test run, http/tests/websocket/tests/hybi/contentextensions/block-cookies.php and http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker.php are flaky failures on El Capitan and Yosemite Release WK2

https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205581%20(9262)/results.html

http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies-worker.php
http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies.php

--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-actual.txt
@@ -3,7 +3,7 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 worker WebSocket open
-PASS worker WebSocket message (no cookies)
+PASS worker WebSocket message (cookie:WK-websocket-test-httponly=1)
 PASS successfullyParsed is true
 
 TEST COMPLETE

--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-actual.txt
@@ -3,7 +3,7 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 WebSocket open
-WebSocket message (no cookies)
+WebSocket message (cookie:WK-websocket-test-httponly=1)
 PASS successfullyParsed is true
 
 TEST COMPLETE

[Ryan Haddad]

These tests became very flaky ~5 days ago.

[Ryan Haddad]

This run had even more of the tests in this directory failing

https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205743%20(9312)/results.html

  http/tests/websocket/tests/hybi/contentextensions/block-cookies.php [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/block-worker.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/block.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/display-none-worker.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/display-none.html [ Failure ]

[Alex Christensen]

strange

[Alex Christensen]

I saw one of these flakes a few weeks ago.

[Ryan Haddad]

Another failing run:

https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20%28Tests%29/builds/9400

From stderr:

2016-09-13 14:08:49.902 WebKitTestRunner[52473:61400357] Extension compilation failed: Unspecified error during compile.

[Alex Christensen]

rdar://27788755