Bug 207839

Summary: [ Mac wk2 ] webgpu/whlsl/loops-break.html is flaky failing.
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: WebGPUAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Mac   
OS: macOS 10.15   

Description Jason Lawrence 2020-02-17 08:07:38 PST
webgpu/whlsl/loops-break.html

Description:
This test is flaky failing on Mac wk2. It is flaky failing throughout the visible history, the oldest diff that I'm able to locate (r254260) matches the current diff.

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Floops-break.html&limit=50000


Diff:
https://build.webkit.org/results/Apple-Catalina-Release-WK2-Tests/r256728%20(2989)/webgpu/whlsl/loops-break-diff.png
Comment 1 Radar WebKit Bug Importer 2020-02-17 08:08:17 PST
<rdar://problem/59510926>
Comment 2 Jason Lawrence 2020-02-17 08:17:38 PST
I have marked this test as failing while this issue is being investigated.
Comment 3 Jason Lawrence 2020-02-17 17:10:34 PST
I am able to reproduce this issue with r256774 using the command below.
run-webkit-tests webgpu/whlsl/loops-break.html --iterations 3000 --exit-after-n-failures 5 -g

[57/3000] webgpu/whlsl/loops-break.html failed unexpectedly (reference mismatch)
[344/3000] webgpu/whlsl/loops-break.html failed unexpectedly (reference mismatch)
[597/3000] webgpu/whlsl/loops-break.html failed unexpectedly (reference mismatch)
[617/3000] webgpu/whlsl/loops-break.html failed unexpectedly (reference mismatch)
[705/3000] webgpu/whlsl/loops-break.html failed unexpectedly (reference mismatch)
Exiting early after 5 failures. 705 tests run.

700 tests ran as expected, 5 didn't (2295 didn't run):