Bug 239386 - [ Monterey wk2 debug ] WebGL conformance tests are a flaky time out
Summary: [ Monterey wk2 debug ] WebGL conformance tests are a flaky time out
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebGL (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Karl Rackler
URL:
Keywords: InRadar
Depends on:
Blocks: webglflaky
  Show dependency treegraph
 
Reported: 2022-04-15 08:07 PDT by Karl Rackler
Modified: 2022-05-24 09:14 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-04-15 08:07:01 PDT
Description:
webgl/1.0.3/conformance/context/context-eviction-with-garbage-collection.html
webgl/1.0.3/conformance/context/context-release-with-workers.html
webgl/1.0.3/conformance/textures/copy-tex-image-and-sub-image-2d.html
webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-array-buffer-view.html
webgl/1.0.3/conformance/textures/texture-size-cube-maps.html
webgl/1.0.3/conformance/textures/texture-size-limit.html
webgl/1.0.3/conformance/textures/texture-size.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgb-rgb-unsigned_byte.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgb-rgb-unsigned_short_5_6_5.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_byte.html
webgl/2.0.0/conformance/textures/misc/copy-tex-image-and-sub-image-2d.html
webgl/1.0.3/conformance/uniforms/uniform-default-values.html
webgl/2.0.0/conformance/canvas/rapid-resizing.html
webgl/2.0.0/conformance/context/context-eviction-with-garbage-collection.html
webgl/2.0.0/conformance/context/context-release-upon-reload.html
webgl/2.0.0/conformance/extensions/webgl-compressed-texture-s3tc-srgb.html
webgl/2.0.0/conformance/extensions/webgl-compressed-texture-s3tc.html
webgl/2.0.0/conformance2/buffers/buffer-copying-contents.html

There was not one commit that I observe causing this issue.  These tests seem to have been flaky since the start.

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Fcontext%2Fcontext-eviction-with-garbage-collection.html&test=webgl%2F1.0.3%2Fconformance%2Fcontext%2Fcontext-release-with-workers.html&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Fcopy-tex-image-and-sub-image-2d.html&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftex-image-and-sub-image-2d-with-array-buffer-view.html&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftexture-size-cube-maps.html&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftexture-size-limit.html&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftexture-size.html&test=webgl%2F1.0.3%2Fconformance%2Funiforms%2Funiform-default-values.html&test=webgl%2F2.0.0%2Fconformance%2Fcanvas%2Frapid-resizing.html&test=webgl%2F2.0.0%2Fconformance%2Fcontext%2Fcontext-eviction-with-garbage-collection.html&test=webgl%2F2.0.0%2Fconformance%2Fcontext%2Fcontext-release-upon-reload.html&test=webgl%2F2.0.0%2Fconformance%2Fextensions%2Fwebgl-compressed-texture-s3tc-srgb.html&test=webgl%2F2.0.0%2Fconformance%2Fextensions%2Fwebgl-compressed-texture-s3tc.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgb-rgb-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgb-rgb-unsigned_short_5_6_5.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgba-rgba-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fmisc%2Fcopy-tex-image-and-sub-image-2d.html&test=webgl%2F2.0.0%2Fconformance2%2Fbuffers%2Fbuffer-copying-contents.html&platform=mac&version_name=Monterey&style=debug&architecture=x86_64&flavor=wk2&limit=50000

Diff:
There was a time out but the system was unable to capture a log correctly.

webgl/1.0.3/conformance/context/context-eviction-with-garbage-collection.html
Link to diff: https://build.webkit.org/results/Apple-Monterey-Debug-WK2-Tests/r292881%20(911)/webgl/1.0.3/conformance/context/context-eviction-with-garbage-collection.html-diff.txt
Comment 1 Radar WebKit Bug Importer 2022-04-15 08:07:23 PDT
<rdar://problem/91807783>
Comment 2 Karl Rackler 2022-04-15 08:43:55 PDT
I have marked these tests as failing while this issue is investigated.

Canonical link: https://commits.webkit.org/249678@main
git-svn-id: https://svn.webkit.org/repository/webkit/trunk@292908
Comment 3 Karl Rackler 2022-04-15 17:12:36 PDT
I have marked these additional tests as failing while this issue is investigated.

webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_short_4_4_4_4.html
webgl/2.0.0/conformance/uniforms/uniform-values-per-program.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_short_5_5_5_1.html

Canonical link: https://commits.webkit.org/249696@main
git-svn-id: https://svn.webkit.org/repository/webkit/trunk@292931
Comment 4 Karl Rackler 2022-05-23 14:30:37 PDT
Description:
webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-array-buffer-view.html

[ Monterey Release wk2 ] is also affected.

I have updated this test as a flaky timeout while this issue is investigated.
Comment 5 Karl Rackler 2022-05-23 14:33:46 PDT
Pull request: https://github.com/WebKit/WebKit/pull/942
Comment 6 EWS 2022-05-23 14:36:41 PDT
Test gardening commit r294683 (250892@main): <https://commits.webkit.org/250892@main>

Reviewed commits have been landed. Closing PR #942 and removing active labels.
Comment 7 Karl Rackler 2022-05-24 09:09:25 PDT
The dashboard shows that some WebGL tests are also flaky timeout on Monterey Release wk2 x86_64.

Description:
webgl/1.0.3/conformance/textures/texture-size-cube-maps.html
webgl/1.0.3/conformance/uniforms/uniform-default-values.html
webgl/2.0.0/conformance/canvas/rapid-resizing.html
webgl/2.0.0/conformance/rendering/multisample-corruption.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgb-rgb-unsigned_byte.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgb-rgb-unsigned_short_5_6_5.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_byte.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_short_4_4_4_4.html
webgl/2.0.0/conformance/textures/image_bitmap_from_canvas/tex-2d-rgba-rgba-unsigned_short_5_5_5_1.html
webgl/2.0.0/conformance/textures/misc/copy-tex-image-and-sub-image-2d.html

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftexture-size-cube-maps.html&test=webgl%2F1.0.3%2Fconformance%2Funiforms%2Funiform-default-values.html&test=webgl%2F2.0.0%2Fconformance%2Fcanvas%2Frapid-resizing.html&test=webgl%2F2.0.0%2Fconformance%2Frendering%2Fmultisample-corruption.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgb-rgb-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgb-rgb-unsigned_short_5_6_5.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgba-rgba-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgba-rgba-unsigned_short_4_4_4_4.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_canvas%2Ftex-2d-rgba-rgba-unsigned_short_5_5_5_1.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fmisc%2Fcopy-tex-image-and-sub-image-2d.html&platform=mac&flavor=wk2&style=release&version_name=Monterey&architecture=x86_64&limit=50000

I have updated these tests are a flaky timeout while this issue is investigated.
Comment 8 Karl Rackler 2022-05-24 09:11:32 PDT
Pull request: https://github.com/WebKit/WebKit/pull/976
Comment 9 EWS 2022-05-24 09:14:56 PDT
Test gardening commit r294749 (250917@main): <https://commits.webkit.org/250917@main>

Reviewed commits have been landed. Closing PR #976 and removing active labels.