Bug 161732 - REGRESSION: LayoutTests http/tests/websocket/tests/hybi/contentextensions/block-cookies* are flaky failures
Summary: REGRESSION: LayoutTests http/tests/websocket/tests/hybi/contentextensions/blo...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-09-07 22:22 PDT by Ryan Haddad
Modified: 2016-10-04 15:14 PDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-09-07 22:22:32 PDT 
As seen on this test run, http/tests/websocket/tests/hybi/contentextensions/block-cookies.php and http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker.php are flaky failures on El Capitan and Yosemite Release WK2

https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205581%20(9262)/results.html

http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies-worker.php
http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fwebsocket%2Ftests%2Fhybi%2Fcontentextensions%2Fblock-cookies.php

--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-worker-actual.txt
@@ -3,7 +3,7 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 worker WebSocket open
-PASS worker WebSocket message (no cookies)
+PASS worker WebSocket message (cookie:WK-websocket-test-httponly=1)
 PASS successfullyParsed is true
 
 TEST COMPLETE

--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/websocket/tests/hybi/contentextensions/block-cookies-actual.txt
@@ -3,7 +3,7 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 WebSocket open
-WebSocket message (no cookies)
+WebSocket message (cookie:WK-websocket-test-httponly=1)
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 1 Ryan Haddad 2016-09-07 22:26:23 PDT 
These tests became very flaky ~5 days ago.
Comment 2 Ryan Haddad 2016-09-09 09:25:46 PDT 
This run had even more of the tests in this directory failing

https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r205743%20(9312)/results.html

  http/tests/websocket/tests/hybi/contentextensions/block-cookies.php [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/block-worker.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/block.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/display-none-worker.html [ Failure ]
  http/tests/websocket/tests/hybi/contentextensions/display-none.html [ Failure ]
Comment 3 Alex Christensen 2016-09-09 09:47:14 PDT 
strange
Comment 4 Alex Christensen 2016-09-09 09:47:37 PDT 
I saw one of these flakes a few weeks ago.
Comment 5 Ryan Haddad 2016-09-13 14:43:22 PDT 
Another failing run:

https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20%28Tests%29/builds/9400

From stderr:

2016-09-13 14:08:49.902 WebKitTestRunner[52473:61400357] Extension compilation failed: Unspecified error during compile.
Comment 6 Alex Christensen 2016-10-04 15:14:32 PDT 
rdar://27788755