Bug 228703

Summary:	4 webgl/2.0.0/deqp/functional/gles3/ tests are failing
Product:	WebKit	Reporter:	ayumi_kojima
Component:	WebGL	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	bfulgham, dino, ehutchison, hhjalmarsson, kbr, kkinnunen, kpiddington, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac (Intel)
OS:	Unspecified

Description ayumi_kojima 2021-08-02 09:48:21 PDT

webgl/2.0.0/deqp/functional/gles3/fbomultisample.2_samples.html
webgl/2.0.0/deqp/functional/gles3/fbomultisample.4_samples.html
webgl/2.0.0/deqp/functional/gles3/fbomultisample.8_samples.html
webgl/2.0.0/deqp/functional/gles3/shadertexturefunction/texturegrad.html

Are consistently failing on Big Sur E wk2 Release.

History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=webgl%2F2.0.0%2Fdeqp%2Ffunctional%2Fgles3%2Ffbomultisample.4_samples.html&test=webgl%2F2.0.0%2Fdeqp%2Ffunctional%2Fgles3%2Ffbomultisample.2_samples.html&test=webgl%2F2.0.0%2Fdeqp%2Ffunctional%2Fgles3%2Ffbomultisample.8_samples.html&test=webgl%2F2.0.0%2Fdeqp%2Ffunctional%2Fgles3%2Fshadertexturefunction%2Ftexturegrad.html

Result page: https://build.webkit.org/results/Apple-BigSur-Release-WK2-WebGL-Tests/r280527%20(2502)/results.html

Diff (webgl/2.0.0/deqp/functional/gles3/fbomultisample.* tests): 

--- /Volumes/Data/worker/bigsur-release-tests-wk2-webgl/build/layout-test-results/webgl/2.0.0/deqp/functional/gles3/fbomultisample.2_samples-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2-webgl/build/layout-test-results/webgl/2.0.0/deqp/functional/gles3/fbomultisample.2_samples-actual.txt
@@ -1,4 +1,27 @@
 This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL.
 
 Test: ../../../resources/webgl_test_files/deqp/functional/gles3/fbomultisample.2_samples.html
-[ PASS ] All tests passed
+
+[ 1: PASS ] msaa.2_samples.rgba8:
+[ 2: PASS ] msaa.2_samples.srgb8_alpha8:
+[ 3: PASS ] msaa.2_samples.rgb10_a2:
+[ 4: PASS ] msaa.2_samples.rgba4:
+[ 5: PASS ] msaa.2_samples.rgb5_a1:
+[ 6: PASS ] msaa.2_samples.rgb8:
+[ 7: PASS ] msaa.2_samples.rgb565:
+[ 8: PASS ] msaa.2_samples.rg8:
+[ 9: PASS ] msaa.2_samples.r8:
+[ 10: PASS ] msaa.2_samples.rgba32f:
+[ 11: PASS ] msaa.2_samples.rgba16f:
+[ 12: PASS ] msaa.2_samples.rg32f:
+[ 13: PASS ] msaa.2_samples.rg16f:
+[ 14: PASS ] msaa.2_samples.r32f:
+[ 15: PASS ] msaa.2_samples.r16f:
+[ 16: PASS ] msaa.2_samples.depth_component32f:
+[ 17: PASS ] msaa.2_samples.depth_component24:
+[ 18: PASS ] msaa.2_samples.depth_component16:
+[ 19: PASS ] msaa.2_samples.depth32f_stencil8:
+[ 20: PASS ] msaa.2_samples.depth24_stencil8:
+[ 21: FAIL ] msaa.2_samples.stencil_index8:
+[ 22: PASS ] msaa.2_samples.stencil_index8: successfullyParsed is true
+[ FAIL ] 1 failures reported



Diff (webgl/2.0.0/deqp/functional/gles3/shadertexturefunction/texturegrad.html):

--- /Volumes/Data/worker/bigsur-release-tests-wk2-webgl/build/layout-test-results/webgl/2.0.0/deqp/functional/gles3/shadertexturefunction/texturegrad-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2-webgl/build/layout-test-results/webgl/2.0.0/deqp/functional/gles3/shadertexturefunction/texturegrad-actual.txt
@@ -1,4 +1,38 @@
 This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL.
 
 Test: ../../../../resources/webgl_test_files/deqp/functional/gles3/shadertexturefunction/texturegrad.html
-[ PASS ] All tests passed
+
+[ 1: PASS ] texture_functions.texturegrad.sampler2d_fixed_vertex: Pass
+[ 2: PASS ] texture_functions.texturegrad.sampler2d_fixed_fragment: Pass
+[ 3: PASS ] texture_functions.texturegrad.sampler2d_float_vertex: Pass
+[ 4: PASS ] texture_functions.texturegrad.sampler2d_float_fragment: Pass
+[ 5: PASS ] texture_functions.texturegrad.isampler2d_vertex: Pass
+[ 6: PASS ] texture_functions.texturegrad.isampler2d_fragment: Pass
+[ 7: PASS ] texture_functions.texturegrad.usampler2d_vertex: Pass
+[ 8: PASS ] texture_functions.texturegrad.usampler2d_fragment: Pass
+[ 9: FAIL ] texture_functions.texturegrad.samplercube_fixed_vertex: Fail
+[ 10: FAIL ] texture_functions.texturegrad.samplercube_fixed_fragment: Fail
+[ 11: FAIL ] texture_functions.texturegrad.samplercube_float_vertex: Fail
+[ 12: FAIL ] texture_functions.texturegrad.samplercube_float_fragment: Fail
+[ 13: FAIL ] texture_functions.texturegrad.isamplercube_vertex: Fail
+[ 14: FAIL ] texture_functions.texturegrad.isamplercube_fragment: Fail
+[ 15: FAIL ] texture_functions.texturegrad.usamplercube_vertex: Fail
+[ 16: FAIL ] texture_functions.texturegrad.usamplercube_fragment: Fail
+[ 17: PASS ] texture_functions.texturegrad.sampler2darray_fixed_vertex: Pass
+[ 18: PASS ] texture_functions.texturegrad.sampler2darray_fixed_fragment: Pass
+[ 19: PASS ] texture_functions.texturegrad.sampler2darray_float_vertex: Pass
+[ 20: PASS ] texture_functions.texturegrad.sampler2darray_float_fragment: Pass
+[ 21: PASS ] texture_functions.texturegrad.isampler2darray_vertex: Pass
+[ 22: PASS ] texture_functions.texturegrad.isampler2darray_fragment: Pass
+[ 23: PASS ] texture_functions.texturegrad.usampler2darray_vertex: Pass
+[ 24: PASS ] texture_functions.texturegrad.usampler2darray_fragment: Pass
+[ 25: PASS ] texture_functions.texturegrad.sampler3d_fixed_vertex: Pass
+[ 26: PASS ] texture_functions.texturegrad.sampler3d_fixed_fragment: Pass
+[ 27: PASS ] texture_functions.texturegrad.sampler3d_float_vertex: Pass
+[ 28: PASS ] texture_functions.texturegrad.sampler3d_float_fragment: Pass
+[ 29: PASS ] texture_functions.texturegrad.isampler3d_vertex: Pass
+[ 30: PASS ] texture_functions.texturegrad.isampler3d_fragment: Pass
+[ 31: PASS ] texture_functions.texturegrad.usampler3d_vertex: Pass
+[ 32: PASS ] texture_functions.texturegrad.usampler3d_fragment: Pass
+[ 33: PASS ] texture_functions.texturegrad.sampler2darrayshadow_fragment: successfullyParsed is true
+[ FAIL ] 8 failures reported

Comment 1 Radar WebKit Bug Importer 2021-08-02 11:53:23 PDT

<rdar://problem/81422463>

Comment 2 Alexey Proskuryakov 2021-08-02 22:43:09 PDT

iMac16,2: Intel Iris Pro Graphics 6200. I don't think that we have these tests enabled on any other hardware.

Comment 3 Eric Hutchison 2021-08-24 14:41:41 PDT

Updated test expectations at https://trac.webkit.org/changeset/281518/webkit.

Comment 4 Eric Hutchison 2021-08-26 12:22:58 PDT

Resolve expectations at https://trac.webkit.org/changeset/281642/webkit.

Comment 5 Brent Fulgham 2022-06-23 13:57:27 PDT

Beth (5/18/2022):

depq tests are not very representative of user-observed behavior. Out of time.

Actually, these are now passing, with a very rare timeout.

Comment 6 EWS 2022-07-26 11:16:00 PDT

Test gardening commit 252835@main (fa7620b947b6): <https://commits.webkit.org/252835@main>

Reviewed commits have been landed. Closing PR #2743 and removing active labels.

Comment 7 Hercules Hjalmarsson 2022-07-26 11:23:13 PDT

(In reply to EWS from comment #6)
> Test gardening commit 252835@main (fa7620b947b6):
> <https://commits.webkit.org/252835@main>
> 
> Reviewed commits have been landed. Closing PR #2743 and removing active
> labels.

Removed expectations in above commit.