Bug 208005 - [ Mac wk2 ] webgpu/whlsl/zero-initialize-values.html is flaky failing.
Summary: [ Mac wk2 ] webgpu/whlsl/zero-initialize-values.html is flaky failing.
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebGPU (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-20 07:46 PST by Jason Lawrence
Modified: 2020-02-20 07:52 PST (History)
2 users (show)

See Also:


Attachments
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png (3.47 KB, image/png)
2020-02-20 07:46 PST, Jason Lawrence
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-02-20 07:46:32 PST
Created attachment 391287 [details]
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png

webgpu/whlsl/zero-initialize-values.html

Description:
This test is flaky failing on Mac. The test is flaky failing throughout the visible history. The oldest diff that I am able to load, r254201, has the same percentage and looks the same.

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fzero-initialize-values.html&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png
Comment 1 Radar WebKit Bug Importer 2020-02-20 07:46:56 PST
<rdar://problem/59628835>
Comment 2 Jason Lawrence 2020-02-20 07:50:43 PST
I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/257060/webkit
Comment 3 Jason Lawrence 2020-02-20 07:52:22 PST
I can reproduce the issue with r257052 using the command below.
run-webkit-tests webgpu/whlsl/zero-initialize-values.html --iterations 4000 --exit-after-n-failures 5 -f --force -g

[33/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[38/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[50/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[60/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[61/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
Exiting early after 5 failures. 58 tests run.

53 tests ran as expected, 5 didn't (3942 didn't run):