Bug 200794

Summary: Layout Test imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html is a flaky failure (test harness timeout)
Product: WebKit Reporter: Russell Epstein <repstein>
Component: Tools / TestsAssignee: Chris Dumez <cdumez>
Status: RESOLVED FIXED    
Severity: Normal CC: beidson, cdumez, commit-queue, ggaren, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
URL: https://github.com/web-platform-tests/wpt/pull/20655
See Also: https://bugs.webkit.org/show_bug.cgi?id=181837
Attachments:
Description Flags
Patch
none
Patch
none
Patch
none
Patch none

Description Russell Epstein 2019-08-15 16:10:43 PDT
The following layout test is flaky on iOS

imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html

Steps to Reproduce:

run-webkit-tests --ios-simulator --no-retry --no-sample-on-timeout imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html --iter 10

This test has been known to be flaky for a long time, tracked in webkit.org/b/181837; however, the test is now failing in an additional way. It appears that the test harness is timing out (see Diff below).

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fready.https.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/ready.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/ready.https-actual.txt
@@ -1,5 +1,5 @@
-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
+
+Harness Error (TIMEOUT), message = null
 
 PASS ready returns the same Promise object 
 PASS ready returns a Promise object in the context of the related document 
@@ -10,5 +10,5 @@
 PASS ready after a longer matched registration registered 
 PASS access ready after it has been resolved 
 FAIL resolve ready after unregistering and reregistering assert_not_equals: Registrations should be different got disallowed value object "[object ServiceWorkerRegistration]"
-FAIL resolve ready before unregistering and reregistering assert_equals: Resolves with the first registration expected "https://localhost:9443/service-workers/service-worker/resources/empty-worker.js" but got "https://localhost:9443/service-workers/service-worker/resources/empty-worker.js?2"
+TIMEOUT resolve ready before unregistering and reregistering Test timed out
Comment 1 Radar WebKit Bug Importer 2019-08-15 16:11:17 PDT
<rdar://problem/54367769>
Comment 2 Chris Dumez 2019-12-13 12:56:52 PST
Created attachment 385634 [details]
Patch
Comment 3 Chris Dumez 2019-12-13 12:59:14 PST
Created attachment 385635 [details]
Patch
Comment 4 Chris Dumez 2019-12-13 13:32:42 PST
Created attachment 385637 [details]
Patch
Comment 5 Chris Dumez 2019-12-13 16:43:42 PST
Created attachment 385657 [details]
Patch
Comment 6 WebKit Commit Bot 2019-12-16 08:55:03 PST
Comment on attachment 385657 [details]
Patch

Clearing flags on attachment: 385657

Committed r253556: <https://trac.webkit.org/changeset/253556>
Comment 7 WebKit Commit Bot 2019-12-16 08:55:05 PST
All reviewed patches have been landed.  Closing bug.