Layout Test imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling.html is flaky

• Component: New Bugs
• Status: NEW ---

[Matt Lewis]

The following layout test is flaky on all platforms

imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling.html

Probable cause:

The test was updated for a crashing issue in https://bugs.webkit.org/show_bug.cgi?id=181980, but it remains a flaky failure on all platforms.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fscripting-1%2Fthe-script-element%2Fmodule%2Ferrorhandling.html

https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/r227680%20(2546)/results.html

diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/errorhandling-actual.txt
@@ -1,6 +1,6 @@
+CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: TypeError: 'text/plain' is not a valid JavaScript MIME type.
 CONSOLE MESSAGE: TypeError: 'text/plain' is not a valid JavaScript MIME type.
-CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal
 CONSOLE MESSAGE: line 1: SyntaxError: No identifiers allowed directly after numeric literal

[Matt Lewis]

Marked as flaky until this can be investigated further:
https://trac.webkit.org/changeset/227766/webkit

[Yusuke Suzuki]

Thanks. I think this is inherently flaky since the order of this console message depends on network's arrival order. We need to disable console message dump in expect files in web-platform-tests.

[Yusuke Suzuki]

*** Bug 182245 has been marked as a duplicate of this bug. ***