224114 2021-04-02 09:10:15 -0700 [GTK][WPE] Test imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming-bad-imports.any.worker.html is flaky and fails sometimes 2023-01-10 07:46:34 -0800 1 1 1 Unclassified WebKit WPE WebKit WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED https://bugs.webkit.org/show_bug.cgi?id=223131 P2 Normal --- 1 clopez webkit-unassigned bugs-noreply dpino ticaiolima oldest_to_newest 1746516 0 clopez 2021-04-02 09:10:15 -0700 The test gamepad/gamepad-visibility-1.html is flaky and sometimes it fails. When it fails it gives this diff: --- /home/buildbot/worker/wpe-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming-bad-imports.any.worker-expected.txt +++ /home/buildbot/worker/wpe-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming-bad-imports.any.worker-actual.txt @@ -1,3 +1,5 @@ + +Harness Error (TIMEOUT), message = null PASS Non-object imports argument: null PASS Non-object imports argument: true @@ -49,60 +51,60 @@ PASS Importing an i64 global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) PASS Importing an i64 global with an incorrectly-typed value: Number PASS Importing an i64 global with an incorrectly-typed value: WebAssembly.Global object (wrong value type) -PASS Importing an f32 global with an incorrectly-typed value: undefined -PASS Importing an f32 global with an incorrectly-typed value: null -PASS Importing an f32 global with an incorrectly-typed value: true -PASS Importing an f32 global with an incorrectly-typed value: "" -PASS Importing an f32 global with an incorrectly-typed value: symbol "Symbol()" -PASS Importing an f32 global with an incorrectly-typed value: plain object -PASS Importing an f32 global with an incorrectly-typed value: WebAssembly.Global -PASS Importing an f32 global with an incorrectly-typed value: WebAssembly.Global.prototype -PASS Importing an f32 global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) -PASS Importing an f32 global with an incorrectly-typed value: BigInt -PASS Importing an f32 global with an incorrectly-typed value: WebAssembly.Global object (wrong value type) -PASS Importing an f64 global with an incorrectly-typed value: undefined -PASS Importing an f64 global with an incorrectly-typed value: null -PASS Importing an f64 global with an incorrectly-typed value: true -PASS Importing an f64 global with an incorrectly-typed value: "" -PASS Importing an f64 global with an incorrectly-typed value: symbol "Symbol()" -PASS Importing an f64 global with an incorrectly-typed value: plain object -PASS Importing an f64 global with an incorrectly-typed value: WebAssembly.Global -PASS Importing an f64 global with an incorrectly-typed value: WebAssembly.Global.prototype -PASS Importing an f64 global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) -PASS Importing an f64 global with an incorrectly-typed value: BigInt -PASS Importing an f64 global with an incorrectly-typed value: WebAssembly.Global object (wrong value type) -PASS Importing an i32 mutable global with a primitive value -PASS Importing an i32 mutable global with an immutable Global object -PASS Importing an i64 mutable global with a primitive value -PASS Importing an i64 mutable global with an immutable Global object -PASS Importing an f32 mutable global with a primitive value -PASS Importing an f32 mutable global with an immutable Global object -PASS Importing an f64 mutable global with a primitive value -PASS Importing an f64 mutable global with an immutable Global object -PASS Importing memory with an incorrectly-typed value: undefined -PASS Importing memory with an incorrectly-typed value: null -PASS Importing memory with an incorrectly-typed value: true -PASS Importing memory with an incorrectly-typed value: "" -PASS Importing memory with an incorrectly-typed value: symbol "Symbol()" -PASS Importing memory with an incorrectly-typed value: 1 -PASS Importing memory with an incorrectly-typed value: 0.1 -PASS Importing memory with an incorrectly-typed value: NaN -PASS Importing memory with an incorrectly-typed value: plain object -PASS Importing memory with an incorrectly-typed value: WebAssembly.Memory -PASS Importing memory with an incorrectly-typed value: WebAssembly.Memory.prototype -PASS Importing memory with an incorrectly-typed value: Object.create(WebAssembly.Memory.prototype) -PASS Importing memory with an incorrectly-typed value: WebAssembly.Memory object (too large) -PASS Importing table with an incorrectly-typed value: undefined -PASS Importing table with an incorrectly-typed value: null -PASS Importing table with an incorrectly-typed value: true -PASS Importing table with an incorrectly-typed value: "" -PASS Importing table with an incorrectly-typed value: symbol "Symbol()" -PASS Importing table with an incorrectly-typed value: 1 -PASS Importing table with an incorrectly-typed value: 0.1 -PASS Importing table with an incorrectly-typed value: NaN -PASS Importing table with an incorrectly-typed value: plain object -PASS Importing table with an incorrectly-typed value: WebAssembly.Table -PASS Importing table with an incorrectly-typed value: WebAssembly.Table.prototype -PASS Importing table with an incorrectly-typed value: Object.create(WebAssembly.Table.prototype) -PASS Importing table with an incorrectly-typed value: WebAssembly.Table object (too large) +TIMEOUT Importing an f32 global with an incorrectly-typed value: undefined Test timed out +NOTRUN Importing an f32 global with an incorrectly-typed value: null +NOTRUN Importing an f32 global with an incorrectly-typed value: true +NOTRUN Importing an f32 global with an incorrectly-typed value: "" +NOTRUN Importing an f32 global with an incorrectly-typed value: symbol "Symbol()" +NOTRUN Importing an f32 global with an incorrectly-typed value: plain object +NOTRUN Importing an f32 global with an incorrectly-typed value: WebAssembly.Global +NOTRUN Importing an f32 global with an incorrectly-typed value: WebAssembly.Global.prototype +NOTRUN Importing an f32 global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) +NOTRUN Importing an f32 global with an incorrectly-typed value: BigInt +NOTRUN Importing an f32 global with an incorrectly-typed value: WebAssembly.Global object (wrong value type) +NOTRUN Importing an f64 global with an incorrectly-typed value: undefined +NOTRUN Importing an f64 global with an incorrectly-typed value: null +NOTRUN Importing an f64 global with an incorrectly-typed value: true +NOTRUN Importing an f64 global with an incorrectly-typed value: "" +NOTRUN Importing an f64 global with an incorrectly-typed value: symbol "Symbol()" +NOTRUN Importing an f64 global with an incorrectly-typed value: plain object +NOTRUN Importing an f64 global with an incorrectly-typed value: WebAssembly.Global +NOTRUN Importing an f64 global with an incorrectly-typed value: WebAssembly.Global.prototype +NOTRUN Importing an f64 global with an incorrectly-typed value: Object.create(WebAssembly.Global.prototype) +NOTRUN Importing an f64 global with an incorrectly-typed value: BigInt +NOTRUN Importing an f64 global with an incorrectly-typed value: WebAssembly.Global object (wrong value type) +NOTRUN Importing an i32 mutable global with a primitive value +NOTRUN Importing an i32 mutable global with an immutable Global object +NOTRUN Importing an i64 mutable global with a primitive value +NOTRUN Importing an i64 mutable global with an immutable Global object +NOTRUN Importing an f32 mutable global with a primitive value +NOTRUN Importing an f32 mutable global with an immutable Global object +NOTRUN Importing an f64 mutable global with a primitive value +NOTRUN Importing an f64 mutable global with an immutable Global object +NOTRUN Importing memory with an incorrectly-typed value: undefined +NOTRUN Importing memory with an incorrectly-typed value: null +NOTRUN Importing memory with an incorrectly-typed value: true +NOTRUN Importing memory with an incorrectly-typed value: "" +NOTRUN Importing memory with an incorrectly-typed value: symbol "Symbol()" +NOTRUN Importing memory with an incorrectly-typed value: 1 +NOTRUN Importing memory with an incorrectly-typed value: 0.1 +NOTRUN Importing memory with an incorrectly-typed value: NaN +NOTRUN Importing memory with an incorrectly-typed value: plain object +NOTRUN Importing memory with an incorrectly-typed value: WebAssembly.Memory +NOTRUN Importing memory with an incorrectly-typed value: WebAssembly.Memory.prototype +NOTRUN Importing memory with an incorrectly-typed value: Object.create(WebAssembly.Memory.prototype) +NOTRUN Importing memory with an incorrectly-typed value: WebAssembly.Memory object (too large) +NOTRUN Importing table with an incorrectly-typed value: undefined +NOTRUN Importing table with an incorrectly-typed value: null +NOTRUN Importing table with an incorrectly-typed value: true +NOTRUN Importing table with an incorrectly-typed value: "" +NOTRUN Importing table with an incorrectly-typed value: symbol "Symbol()" +NOTRUN Importing table with an incorrectly-typed value: 1 +NOTRUN Importing table with an incorrectly-typed value: 0.1 +NOTRUN Importing table with an incorrectly-typed value: NaN +NOTRUN Importing table with an incorrectly-typed value: plain object +NOTRUN Importing table with an incorrectly-typed value: WebAssembly.Table +NOTRUN Importing table with an incorrectly-typed value: WebAssembly.Table.prototype +NOTRUN Importing table with an incorrectly-typed value: Object.create(WebAssembly.Table.prototype) +NOTRUN Importing table with an incorrectly-typed value: WebAssembly.Table object (too large) Passing something like "--repeat-each=100" to run-webkit-tests may help to reproduce the issue On Mac it seems the same issue happens, but there only on Debug builds: See bug 223131 On GTK/WPE happens also on release 1746517 1 clopez 2021-04-02 09:13:56 -0700 (In reply to Carlos Alberto Lopez Perez from comment #0) > The test gamepad/gamepad-visibility-1.html is flaky and sometimes it fails. > Sorry, I wanted to mean the test: imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming-bad-imports.any.worker.html 1746544 2 clopez 2021-04-02 09:56:53 -0700 Updated expectations on r275423 1754478 3 dpino 2021-04-26 20:24:07 -0700 This other related test is also a flaky timeout: imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming.any.worker.html https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r276624%20%281415%29/imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming.any.worker-diff.txt --- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming.any.worker-expected.txt +++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/wasm/webapi/instantiateStreaming.any.worker-actual.txt @@ -1,3 +1,5 @@ + +Harness Error (TIMEOUT), message = null PASS Empty module without imports argument PASS Empty module with undefined imports argument @@ -23,5 +25,5 @@ PASS i64 mutable WebAssembly.Global import PASS Multiple i64 arguments PASS stray argument -PASS Synchronous options handling +TIMEOUT Synchronous options handling Test timed out 1924454 4 dpino 2023-01-10 07:46:27 -0800 The test or tests filed under this bug are not failing anymore. Test expectations updated in https://commits.webkit.org/258724@main.