Bug 200794 - Layout Test imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html is a flaky failure (test harness timeout)
Summary: Layout Test imported/w3c/web-platform-tests/service-workers/service-worker/re...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Chris Dumez
URL: https://github.com/web-platform-tests...
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-08-15 16:10 PDT by Russell Epstein
Modified: 2019-12-16 08:55 PST (History)
7 users (show)

See Also:


Attachments
Patch (18.24 KB, patch)
2019-12-13 12:56 PST, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (18.29 KB, patch)
2019-12-13 12:59 PST, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (15.77 KB, patch)
2019-12-13 13:32 PST, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (15.78 KB, patch)
2019-12-13 16:43 PST, Chris Dumez
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Russell Epstein 2019-08-15 16:10:43 PDT
The following layout test is flaky on iOS

imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html

Steps to Reproduce:

run-webkit-tests --ios-simulator --no-retry --no-sample-on-timeout imported/w3c/web-platform-tests/service-workers/service-worker/ready.https.html --iter 10

This test has been known to be flaky for a long time, tracked in webkit.org/b/181837; however, the test is now failing in an additional way. It appears that the test harness is timing out (see Diff below).

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fready.https.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/ready.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/ready.https-actual.txt
@@ -1,5 +1,5 @@
-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
+
+Harness Error (TIMEOUT), message = null
 
 PASS ready returns the same Promise object 
 PASS ready returns a Promise object in the context of the related document 
@@ -10,5 +10,5 @@
 PASS ready after a longer matched registration registered 
 PASS access ready after it has been resolved 
 FAIL resolve ready after unregistering and reregistering assert_not_equals: Registrations should be different got disallowed value object "[object ServiceWorkerRegistration]"
-FAIL resolve ready before unregistering and reregistering assert_equals: Resolves with the first registration expected "https://localhost:9443/service-workers/service-worker/resources/empty-worker.js" but got "https://localhost:9443/service-workers/service-worker/resources/empty-worker.js?2"
+TIMEOUT resolve ready before unregistering and reregistering Test timed out
Comment 1 Radar WebKit Bug Importer 2019-08-15 16:11:17 PDT
<rdar://problem/54367769>
Comment 2 Chris Dumez 2019-12-13 12:56:52 PST
Created attachment 385634 [details]
Patch
Comment 3 Chris Dumez 2019-12-13 12:59:14 PST
Created attachment 385635 [details]
Patch
Comment 4 Chris Dumez 2019-12-13 13:32:42 PST
Created attachment 385637 [details]
Patch
Comment 5 Chris Dumez 2019-12-13 16:43:42 PST
Created attachment 385657 [details]
Patch
Comment 6 WebKit Commit Bot 2019-12-16 08:55:03 PST
Comment on attachment 385657 [details]
Patch

Clearing flags on attachment: 385657

Committed r253556: <https://trac.webkit.org/changeset/253556>
Comment 7 WebKit Commit Bot 2019-12-16 08:55:05 PST
All reviewed patches have been landed.  Closing bug.