Bug 207599 - [ Mac wk2 ] webgpu/whlsl/do-while-loop.html is flaky failing.
Summary: [ Mac wk2 ] webgpu/whlsl/do-while-loop.html is flaky failing.
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebGPU (show other bugs)
Version: WebKit Nightly Build
Hardware: Macintosh macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-11 16:34 PST by Jason Lawrence
Modified: 2020-02-12 08:06 PST (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-02-11 16:34:16 PST
webgpu/whlsl/do-while-loop.html

Description:
This test is flaky failing throughout the visible history on Mac wk2. The oldest diff that I am able to find, related to r253677, shows the same image and percentage. 

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fdo-while-loop.html&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Release-WK2-Tests/r254422%20(2065)/webgpu/whlsl/do-while-loop-diff.png
Comment 1 Radar WebKit Bug Importer 2020-02-11 16:34:42 PST
<rdar://problem/59369220>
Comment 2 Jason Lawrence 2020-02-11 16:47:59 PST
I have marked this test as failing while the issue is investigated.
https://trac.webkit.org/changeset/256398/webkit
Comment 3 Jason Lawrence 2020-02-12 08:06:12 PST
I am able to reproduce this issue with r256430 using the command below.

run-webkit-tests webgpu/whlsl/do-while-loop.html --iterations 5000.

Running 6 WebKitTestRunners in parallel.
[792/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[1214/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[1999/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2101/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2483/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2771/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3550/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3680/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3962/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[4803/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[4924/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)