[macOS Debug WK2] LayoutTest imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html is a flaky failure

• Component: New Bugs
• Status: RESOLVED FIXED

[Ryan Haddad]

LayoutTest imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html is a flaky failure

https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r224345%20(3973)/results.html

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fregistration-mime-types.https.html

--- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https-expected.txt
+++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL Registering script with no MIME type assert_unreached: Should have rejected: Registration of no MIME type script should fail. Reached unreachable code
 FAIL Registering script with bad MIME type assert_unreached: Should have rejected: Registration of plain text script should fail. Reached unreachable code
@@ -18,21 +20,21 @@
 PASS Registering script with good MIME type text/javascript1.0 
 PASS Registering script that imports script with good MIME type text/javascript1.0 
 PASS Registering script with good MIME type text/javascript1.1 
-PASS Registering script that imports script with good MIME type text/javascript1.1 
-PASS Registering script with good MIME type text/javascript1.2 
-PASS Registering script that imports script with good MIME type text/javascript1.2 
-PASS Registering script with good MIME type text/javascript1.3 
-PASS Registering script that imports script with good MIME type text/javascript1.3 
-PASS Registering script with good MIME type text/javascript1.4 
-PASS Registering script that imports script with good MIME type text/javascript1.4 
-PASS Registering script with good MIME type text/javascript1.5 
-PASS Registering script that imports script with good MIME type text/javascript1.5 
-PASS Registering script with good MIME type text/jscript 
-PASS Registering script that imports script with good MIME type text/jscript 
-PASS Registering script with good MIME type text/livescript 
-PASS Registering script that imports script with good MIME type text/livescript 
-PASS Registering script with good MIME type text/x-ecmascript 
-PASS Registering script that imports script with good MIME type text/x-ecmascript 
-PASS Registering script with good MIME type text/x-javascript 
-PASS Registering script that imports script with good MIME type text/x-javascript 
+TIMEOUT Registering script that imports script with good MIME type text/javascript1.1 Test timed out
+NOTRUN Registering script with good MIME type text/javascript1.2 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.2 
+NOTRUN Registering script with good MIME type text/javascript1.3 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.3 
+NOTRUN Registering script with good MIME type text/javascript1.4 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.4 
+NOTRUN Registering script with good MIME type text/javascript1.5 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.5 
+NOTRUN Registering script with good MIME type text/jscript 
+NOTRUN Registering script that imports script with good MIME type text/jscript 
+NOTRUN Registering script with good MIME type text/livescript 
+NOTRUN Registering script that imports script with good MIME type text/livescript 
+NOTRUN Registering script with good MIME type text/x-ecmascript 
+NOTRUN Registering script that imports script with good MIME type text/x-ecmascript 
+NOTRUN Registering script with good MIME type text/x-javascript 
+NOTRUN Registering script that imports script with good MIME type text/x-javascript

[Ryan Haddad]

Marked test as flaky in https://trac.webkit.org/r224352

[Radar WebKit Bug Importer]

<rdar://problem/35378504>

[Ryan Haddad]

The flaky expectation was removed, but this test is still frequently failing on macOS Debug WK2

[Matt Lewis]

*** Bug 180989 has been marked as a duplicate of this bug. ***

[Matt Lewis]

Looks to have become flaky again after: https://trac.webkit.org/changeset/225864/webkit

Youenn sugested this in the duplicate bug:

"we should change the expectation to:
[ Debug ] imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html [ Slow ]"

[youenn fablet]

(In reply to Matt Lewis from comment #5)
> Looks to have become flaky again after:
> https://trac.webkit.org/changeset/225864/webkit
> 
> Youenn sugested this in the duplicate bug:
> 
> "we should change the expectation to:
> [ Debug ]
> imported/w3c/web-platform-tests/service-workers/service-worker/registration-
> mime-types.https.html [ Slow ]"

I should have said: we may want to change the expectation...
There might be an actual bug or it is just that the test is taking longer in debug builds.

[Matt Lewis]

Marked as slow in:
https://trac.webkit.org/changeset/226183/webkit

[Chris Dumez]

The test is slow but seems to be consistently passing since it has been marked as slow.