Bug 182177 - Layout Test imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling.html is flaky
Summary: Layout Test imported/w3c/web-platform-tests/html/semantics/scripting-1/the-sc...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
: 182245 (view as bug list)
Depends on:
Blocks:
 
Reported: 2018-01-26 11:20 PST by Matt Lewis
Modified: 2018-01-29 23:50 PST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2018-01-26 11:20:49 PST
The following layout test is flaky on all platforms

imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling.html

Probable cause:

The test was updated for a crashing issue in https://bugs.webkit.org/show_bug.cgi?id=181980, but it remains a flaky failure on all platforms.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fscripting-1%2Fthe-script-element%2Fmodule%2Ferrorhandling.html

https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/r227680%20(2546)/results.html

diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling-actual.txt
@@ -1,6 +1,6 @@
+CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: TypeError: 'text/plain' is not a valid JavaScript MIME type.
 CONSOLE MESSAGE: TypeError: 'text/plain' is not a valid JavaScript MIME type.
-CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
Comment 1 Matt Lewis 2018-01-29 17:34:12 PST
Marked as flaky until this can be investigated further:
https://trac.webkit.org/changeset/227766/webkit
Comment 2 Yusuke Suzuki 2018-01-29 23:38:16 PST
Thanks. I think this is inherently flaky since the order of this console message depends on network's arrival order. We need to disable console message dump in expect files in web-platform-tests.
Comment 3 Yusuke Suzuki 2018-01-29 23:50:13 PST
*** Bug 182245 has been marked as a duplicate of this bug. ***