Bug 179194 - [macOS Debug WK2] LayoutTest imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html is a flaky failure
Summary: [macOS Debug WK2] LayoutTest imported/w3c/web-platform-tests/service-workers/...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 180989 (view as bug list)
Depends on:
Blocks:
 
Reported: 2017-11-02 13:25 PDT by Ryan Haddad
Modified: 2018-01-09 14:55 PST (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2017-11-02 13:25:34 PDT
LayoutTest imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html is a flaky failure

https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r224345%20(3973)/results.html

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fregistration-mime-types.https.html

--- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https-expected.txt
+++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL Registering script with no MIME type assert_unreached: Should have rejected: Registration of no MIME type script should fail. Reached unreachable code
 FAIL Registering script with bad MIME type assert_unreached: Should have rejected: Registration of plain text script should fail. Reached unreachable code
@@ -18,21 +20,21 @@
 PASS Registering script with good MIME type text/javascript1.0 
 PASS Registering script that imports script with good MIME type text/javascript1.0 
 PASS Registering script with good MIME type text/javascript1.1 
-PASS Registering script that imports script with good MIME type text/javascript1.1 
-PASS Registering script with good MIME type text/javascript1.2 
-PASS Registering script that imports script with good MIME type text/javascript1.2 
-PASS Registering script with good MIME type text/javascript1.3 
-PASS Registering script that imports script with good MIME type text/javascript1.3 
-PASS Registering script with good MIME type text/javascript1.4 
-PASS Registering script that imports script with good MIME type text/javascript1.4 
-PASS Registering script with good MIME type text/javascript1.5 
-PASS Registering script that imports script with good MIME type text/javascript1.5 
-PASS Registering script with good MIME type text/jscript 
-PASS Registering script that imports script with good MIME type text/jscript 
-PASS Registering script with good MIME type text/livescript 
-PASS Registering script that imports script with good MIME type text/livescript 
-PASS Registering script with good MIME type text/x-ecmascript 
-PASS Registering script that imports script with good MIME type text/x-ecmascript 
-PASS Registering script with good MIME type text/x-javascript 
-PASS Registering script that imports script with good MIME type text/x-javascript 
+TIMEOUT Registering script that imports script with good MIME type text/javascript1.1 Test timed out
+NOTRUN Registering script with good MIME type text/javascript1.2 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.2 
+NOTRUN Registering script with good MIME type text/javascript1.3 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.3 
+NOTRUN Registering script with good MIME type text/javascript1.4 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.4 
+NOTRUN Registering script with good MIME type text/javascript1.5 
+NOTRUN Registering script that imports script with good MIME type text/javascript1.5 
+NOTRUN Registering script with good MIME type text/jscript 
+NOTRUN Registering script that imports script with good MIME type text/jscript 
+NOTRUN Registering script with good MIME type text/livescript 
+NOTRUN Registering script that imports script with good MIME type text/livescript 
+NOTRUN Registering script with good MIME type text/x-ecmascript 
+NOTRUN Registering script that imports script with good MIME type text/x-ecmascript 
+NOTRUN Registering script with good MIME type text/x-javascript 
+NOTRUN Registering script that imports script with good MIME type text/x-javascript
Comment 1 Ryan Haddad 2017-11-02 13:42:28 PDT
Marked test as flaky in https://trac.webkit.org/r224352
Comment 2 Radar WebKit Bug Importer 2017-11-06 17:44:58 PST
<rdar://problem/35378504>
Comment 3 Ryan Haddad 2017-12-19 10:57:22 PST
The flaky expectation was removed, but this test is still frequently failing on macOS Debug WK2
Comment 4 Matt Lewis 2017-12-20 08:43:33 PST
*** Bug 180989 has been marked as a duplicate of this bug. ***
Comment 5 Matt Lewis 2017-12-20 08:44:43 PST
Looks to have become flaky again after: https://trac.webkit.org/changeset/225864/webkit

Youenn sugested this in the duplicate bug:

"we should change the expectation to:
[ Debug ] imported/w3c/web-platform-tests/service-workers/service-worker/registration-mime-types.https.html [ Slow ]"
Comment 6 youenn fablet 2017-12-20 08:54:27 PST
(In reply to Matt Lewis from comment #5)
> Looks to have become flaky again after:
> https://trac.webkit.org/changeset/225864/webkit
> 
> Youenn sugested this in the duplicate bug:
> 
> "we should change the expectation to:
> [ Debug ]
> imported/w3c/web-platform-tests/service-workers/service-worker/registration-
> mime-types.https.html [ Slow ]"

I should have said: we may want to change the expectation...
There might be an actual bug or it is just that the test is taking longer in debug builds.
Comment 7 Matt Lewis 2017-12-20 09:24:53 PST
Marked as slow in:
https://trac.webkit.org/changeset/226183/webkit
Comment 8 Chris Dumez 2018-01-09 14:55:10 PST
The test is slow but seems to be consistently passing since it has been marked as slow.