Bug 201877 - REGRESSION (macOS): Many webgpu/whlsl* tests are flaky failures.
Summary: REGRESSION (macOS): Many webgpu/whlsl* tests are flaky failures.
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-09-17 11:52 PDT by Russell Epstein
Modified: 2019-09-18 09:11 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Russell Epstein 2019-09-17 11:52:11 PDT
The following layout tests have recently become flaky:

webgpu/whlsl/arbitrary-vertex-attribute-locations.html
webgpu/whlsl/nested-dot-expression-rvalue.html
webgpu/whlsl/ensure-proper-variable-lifetime-3.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-2.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-10.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-11.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-12.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-13.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-14.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-15.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-16.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-17.html 
webgpu/whlsl/separate-shader-modules/separate-shader-modules-18.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-19.html

This issue appears to be limited to specific hardware configurations, potentially due to differences in discrete/integrated GPU:
Macmini8,1
MacbookPro13,3
MacbookPro14,2
MacbookPro15,1
Comment 1 Russell Epstein 2019-09-17 11:52:42 PDT
rdar://55204775
Comment 2 Russell Epstein 2019-09-17 11:58:51 PDT
Marked tests as flaky in r249971, as they are causing a fair amount of noise for bot watchers.
Comment 3 Russell Epstein 2019-09-17 12:02:13 PDT
(In reply to Russell Epstein from comment #2)
> Marked tests as flaky in r249971, as they are causing a fair amount of noise
> for bot watchers.

Corrected TestExpectations in r249972
Comment 4 Russell Epstein 2019-09-18 09:11:14 PDT
Two additional tests are flaky:
webgpu/whlsl/separate-shader-modules/separate-shader-modules-24.html
webgpu/whlsl/separate-shader-modules/separate-shader-modules-26.html

Marked as such in r250038.