Bug 175388 - LayoutTest http/wpt/beacon/keepalive-after-navigation.html is a flaky failure (harness timeout)
Summary: LayoutTest http/wpt/beacon/keepalive-after-navigation.html is a flaky failure...
Status: ASSIGNED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Chris Dumez
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-08-09 09:07 PDT by Ryan Haddad
Modified: 2017-08-09 15:35 PDT (History)
5 users (show)

See Also:


Attachments
Patch (7.32 KB, patch)
2017-08-09 10:16 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Archive of layout-test-results from ews105 for mac-elcapitan-wk2 (1.43 MB, application/zip)
2017-08-09 11:08 PDT, Build Bot
no flags Details
Archive of layout-test-results from ews100 for mac-elcapitan (1012.12 KB, application/zip)
2017-08-09 11:30 PDT, Build Bot
no flags Details
Patch (8.37 KB, patch)
2017-08-09 14:07 PDT, Chris Dumez
buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from ews105 for mac-elcapitan-wk2 (1.12 MB, application/zip)
2017-08-09 15:21 PDT, Build Bot
no flags Details
Archive of layout-test-results from ews100 for mac-elcapitan (1.13 MB, application/zip)
2017-08-09 15:32 PDT, Build Bot
no flags Details
Archive of layout-test-results from ews116 for mac-elcapitan (1.77 MB, application/zip)
2017-08-09 15:35 PDT, Build Bot
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2017-08-09 09:07:51 PDT
LayoutTest http/wpt/beacon/keepalive-after-navigation.html is a flaky failure (harness timeout)

https://build.webkit.org/builders/Apple%20Sierra%20Release%20WK2%20(Tests)/builds/3466

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fbeacon%2Fkeepalive-after-navigation.html

--- /Volumes/Data/slave/sierra-release-tests-wk2/build/layout-test-results/http/wpt/beacon/keepalive-after-navigation-expected.txt
+++ /Volumes/Data/slave/sierra-release-tests-wk2/build/layout-test-results/http/wpt/beacon/keepalive-after-navigation-actual.txt
@@ -1,4 +1,6 @@
 frame "testFrame" - has 1 onunload handler(s)
 
-PASS Test that beacon sent from unload event handler is properly received 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Test that beacon sent from unload event handler is properly received Test timed out
+
Comment 1 Chris Dumez 2017-08-09 10:16:52 PDT
Created attachment 317716 [details]
Patch
Comment 2 youenn fablet 2017-08-09 10:32:03 PDT
Comment on attachment 317716 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=317716&action=review

> LayoutTests/imported/w3c/web-platform-tests/beacon/beacon-navigate.html:12
> +    <script src="beacon-common.js?pipe=sub"></script>

Style only but it would be nicer to rename beacon-common.js as beacon-common.sub.js and remove the ?pipe=sub

Looking at beacon-common.js, the polling mechanism seems fine.
I would tend though to stop polling and raise an error after a long timeout like 5 seconds but I am not sure how WPT would like that change.
Comment 3 Chris Dumez 2017-08-09 10:33:34 PDT
(In reply to youenn fablet from comment #2)
> Comment on attachment 317716 [details]
> Patch
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=317716&action=review
> 
> > LayoutTests/imported/w3c/web-platform-tests/beacon/beacon-navigate.html:12
> > +    <script src="beacon-common.js?pipe=sub"></script>
> 
> Style only but it would be nicer to rename beacon-common.js as
> beacon-common.sub.js and remove the ?pipe=sub
> 
> Looking at beacon-common.js, the polling mechanism seems fine.
> I would tend though to stop polling and raise an error after a long timeout
> like 5 seconds but I am not sure how WPT would like that change.

Would you mind making those comments upstream at https://github.com/w3c/web-platform-tests/pull/6655 ?
Comment 4 Build Bot 2017-08-09 11:08:31 PDT
Comment on attachment 317716 [details]
Patch

Attachment 317716 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/4284999

New failing tests:
imported/w3c/web-platform-tests/beacon/beacon-navigate.html
Comment 5 Build Bot 2017-08-09 11:08:32 PDT
Created attachment 317722 [details]
Archive of layout-test-results from ews105 for mac-elcapitan-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews105  Port: mac-elcapitan-wk2  Platform: Mac OS X 10.11.6
Comment 6 Build Bot 2017-08-09 11:30:25 PDT
Comment on attachment 317716 [details]
Patch

Attachment 317716 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/4285112

New failing tests:
imported/w3c/web-platform-tests/beacon/beacon-navigate.html
Comment 7 Build Bot 2017-08-09 11:30:26 PDT
Created attachment 317723 [details]
Archive of layout-test-results from ews100 for mac-elcapitan

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews100  Port: mac-elcapitan  Platform: Mac OS X 10.11.6
Comment 8 Chris Dumez 2017-08-09 14:07:36 PDT
Created attachment 317737 [details]
Patch
Comment 9 Build Bot 2017-08-09 15:21:51 PDT
Comment on attachment 317737 [details]
Patch

Attachment 317737 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/4286207

New failing tests:
imported/w3c/web-platform-tests/beacon/beacon-navigate.html
Comment 10 Build Bot 2017-08-09 15:21:52 PDT
Created attachment 317752 [details]
Archive of layout-test-results from ews105 for mac-elcapitan-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews105  Port: mac-elcapitan-wk2  Platform: Mac OS X 10.11.6
Comment 11 Build Bot 2017-08-09 15:32:04 PDT
Comment on attachment 317737 [details]
Patch

Attachment 317737 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/4286279

New failing tests:
imported/w3c/web-platform-tests/beacon/beacon-navigate.html
Comment 12 Build Bot 2017-08-09 15:32:05 PDT
Created attachment 317753 [details]
Archive of layout-test-results from ews100 for mac-elcapitan

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews100  Port: mac-elcapitan  Platform: Mac OS X 10.11.6
Comment 13 Build Bot 2017-08-09 15:35:46 PDT
Comment on attachment 317737 [details]
Patch

Attachment 317737 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/4286234

New failing tests:
imported/w3c/web-platform-tests/beacon/beacon-navigate.html
Comment 14 Build Bot 2017-08-09 15:35:47 PDT
Created attachment 317754 [details]
Archive of layout-test-results from ews116 for mac-elcapitan

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews116  Port: mac-elcapitan  Platform: Mac OS X 10.11.6