Bug 207461

Summary: [ macOS ] imported/w3c/web-platform-tests/wasm/jsapi/constructor/instantiate-bad-imports.any.worker.html is flaky failing
Product: WebKit Reporter: Jacob Uphoff <jacob_uphoff>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Jacob Uphoff 2020-02-10 07:57:16 PST
imported/w3c/web-platform-tests/wasm/jsapi/constructor/instantiate-bad-imports.any.worker.html

This test has a long history of flaky failing but was first seen on commit 252083 

I ran the test in iterations x5000 on wk1 and wk2 and the failure did not reproduce 

This is happening on Debug

History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwasm%2Fjsapi%2Fconstructor%2Finstantiate-bad-imports.any.worker.html&limit=50000

Diff:

--- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/wasm/jsapi/constructor/instantiate-bad-imports.any.worker-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/wasm/jsapi/constructor/instantiate-bad-imports.any.worker-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS WebAssembly.instantiate(module): Non-object imports argument: null 
 PASS WebAssembly.instantiate(module): Non-object imports argument: true 
@@ -95,32 +97,32 @@
 PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: true 
 PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: "" 
 PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: symbol "Symbol()" 
-PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: plain object 
-PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: WebAssembly.Global 
-PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: WebAssembly.Global.prototype 
-PASS WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: undefined 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: null 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: true 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: "" 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: symbol "Symbol()" 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: 1 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: 0.1 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: NaN 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: plain object 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: WebAssembly.Memory 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: WebAssembly.Memory.prototype 
-PASS WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: Object.create(WebAssembly.Memory.prototype) 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: undefined 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: null 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: true 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: "" 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: symbol "Symbol()" 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: 1 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: 0.1 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: NaN 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: plain object 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: WebAssembly.Table 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: WebAssembly.Table.prototype 
-PASS WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: Object.create(WebAssembly.Table.prototype) 
+TIMEOUT WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: plain object Test timed out
+NOTRUN WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: WebAssembly.Global 
+NOTRUN WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: WebAssembly.Global.prototype 
+NOTRUN WebAssembly.instantiate(buffer): Importing a global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: undefined 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: null 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: true 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: "" 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: symbol "Symbol()" 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: 1 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: 0.1 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: NaN 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: plain object 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: WebAssembly.Memory 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: WebAssembly.Memory.prototype 
+NOTRUN WebAssembly.instantiate(buffer): Importing memory with an incorrectly-typed value: Object.create(WebAssembly.Memory.prototype) 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: undefined 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: null 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: true 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: "" 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: symbol "Symbol()" 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: 1 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: 0.1 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: NaN 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: plain object 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: WebAssembly.Table 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: WebAssembly.Table.prototype 
+NOTRUN WebAssembly.instantiate(buffer): Importing table with an incorrectly-typed value: Object.create(WebAssembly.Table.prototype)
Comment 1 Radar WebKit Bug Importer 2020-02-10 07:57:35 PST
<rdar://problem/59310805>
Comment 2 Jacob Uphoff 2020-02-10 08:03:19 PST
Updated test expectations in r256171