Bug 296282 – REGRESSION (297343@main): [ macOS Sequoia wk2 Release arm64 ] 25x http/tests/webgpu/webgpu (layout-tests) are constant text failures

• Status: RESOLVED
• Resolution: FIXED
• Component: WebGPU

[Bryan Medina]

25 http/tests/webgpu/webgpu (layout-tests)

are constant text failures on macOS Sequoia wk2 Release on arm64 architecture

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fshader%2Fvalidation%2Fstatement%2Fcontinuing.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Foperation%2Fpipeline%2Fpipeline_layout_created_with_null_bind_group_layout.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxDynamicStorageBuffersPerPipelineLayout.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxInterStageShaderVariables.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxStorageBuffersInFragmentStage.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxStorageBuffersInVertexStage.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxStorageTexturesInFragmentStage.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fcapability_checks%2Flimits%2FmaxStorageTexturesInVertexStage.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2FcreatePipelineLayout.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fapi%2Fvalidation%2Fencoding%2FbeginComputePass.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fshader%2Fvalidation%2Fstatement%2Ffor.html&test=http%2Ftests%2Fwebgpu%2Fwebgpu%2Fshader%2Fvalidation%2Fstatement%2Fphony.html

TEXT DIFFS CAN BE FOUND AT THE FOLLOWING LINK:
https://build.webkit.org/results/Apple-Sequoia-Release-AppleSilicon-WK2-Tests/297670%40main%20(3796)/results.html

TEXT DIFF:
* This is not the text diff for every single test, but this is the most common found in all tests:

   - EXCEPTION: Error: Unexpected validation error occurred: writeIndices mismatch: beginningOfPassWriteIndex(0) >= querySetCount(1) || endOfPassWriteIndex(1) >= querySetCount(1) || timestampWrite.beginningOfPassWriteIndex(0) == timestampWrite.endOfPassWriteIndex(1)

[Radar WebKit Bug Importer]

<rdar://problem/156331513>

[Bryan Medina]

I was able to reproduce these test failures on macOS Sequoia Release ToT running the test as follows:
run-webkit-tests <insert_test_name_here>

[Bryan Medina]

I was able to bisect the regression point by testing 297343@main and it failed, but it passed at 297339@main. Therefore, I have concluded that 297339@main is the regression point.

[EWS]

Test gardening commit 297695@main (2f5b2163f1ef): <https://commits.webkit.org/297695@main>

Reviewed commits have been landed. Closing PR #48333 and removing active labels.

[Bryan Medina]

CORRECTION: The regression point is 297343@main, since that is where it had first failed after consistently passing.

[Mike Wyrzykowski]

I think possibly related to https://commits.webkit.org/297342@main based on the text expectations differences

[Yusuke Suzuki]

It seems that most of these tests are not running on EWS at all. So test expectations are not updated accordingly because we cannot see these failures before the commits.

[Yusuke Suzuki]

Pull request: https://github.com/WebKit/WebKit/pull/48353

[EWS]

Committed 297718@main (08dd19165836): <https://commits.webkit.org/297718@main>

Reviewed commits have been landed. Closing PR #48353 and removing active labels.