Bug 240735 - REGRESSION (r294536): [ macOS Release wk2 ] Twelve webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex are a flaky failure
Summary: REGRESSION (r294536): [ macOS Release wk2 ] Twelve webgl/2.0.0/conformance2/t...
Status: RESOLVED DUPLICATE of bug 240802
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Karl Rackler
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-05-20 14:20 PDT by Karl Rackler
Modified: 2022-05-25 16:20 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-05-20 14:20:10 PDT
Description:
webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgb-rgb-unsigned_short_5_6_5.html
webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgba-rgba-unsigned_byte.html
webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgba-rgba-unsigned_short_4_4_4_4.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r11f_g11f_b10f-rgb-unsigned_int_10f_11f_11f_rev.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r16f-red-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r8-red-unsigned_byte.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-rgb5_a1-rgba-unsigned_short_5_5_5_1.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb16f-rgb-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb565-rgb-unsigned_short_5_6_5.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb9_e5-rgb-half_float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgba32f-rgba-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgba8ui-rgba_integer-unsigned_byte.html

The first failure I saw on the dashboard was on 5/20/2022 at r294536. 

REPRODUCTION STEPS
I can reproduce this on r294536, but unable to reproduce it on r294535 or earlier.

Command: 
run-webkit-tests --root 294536 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgb-rgb-unsigned_short_5_6_5.html

Result: 
Regressions: Unexpected text-only failures (1)
  webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgb-rgb-unsigned_short_5_6_5.html [ Failure ]

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-rgb-rgb-unsigned_short_5_6_5.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-rgba-rgba-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-rgba-rgba-unsigned_short_4_4_4_4.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-r11f_g11f_b10f-rgb-unsigned_int_10f_11f_11f_rev.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-r16f-red-float.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-r8-red-unsigned_byte.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-2d-rgb5_a1-rgba-unsigned_short_5_5_5_1.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-3d-rgb16f-rgb-float.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-3d-rgb565-rgb-unsigned_short_5_6_5.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-3d-rgb9_e5-rgb-half_float.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-3d-rgba32f-rgba-float.html&test=webgl%2F2.0.0%2Fconformance2%2Ftextures%2Fimage_bitmap_from_image_bitmap%2Ftex-3d-rgba8ui-rgba_integer-unsigned_byte.html&platform=mac&style=release&limit=50000

Diff:
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgb-rgb-unsigned_short_5_6_5-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgba-rgba-unsigned_byte-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance/textures/image_bitmap_from_image_bitmap/tex-2d-rgba-rgba-unsigned_short_4_4_4_4-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r11f_g11f_b10f-rgb-unsigned_int_10f_11f_11f_rev-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r16f-red-float-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r8-red-unsigned_byte-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-rgb5_a1-rgba-unsigned_short_5_5_5_1-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb16f-rgb-float-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb565-rgb-unsigned_short_5_6_5-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb9_e5-rgb-half_float-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgba32f-rgba-float-diff.txt
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/250806%40main%20(4184)/webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgba8ui-rgba_integer-unsigned_byte-diff.txt
Comment 1 Radar WebKit Bug Importer 2022-05-20 14:20:25 PDT
<rdar://problem/93678287>
Comment 2 Karl Rackler 2022-05-20 14:29:31 PDT
I have marked this test as a flaky failure while investigating this issue.
Comment 3 Karl Rackler 2022-05-20 14:32:00 PDT
Pull request: https://github.com/WebKit/WebKit/pull/856
Comment 4 EWS 2022-05-20 14:34:31 PDT
Test gardening commit r294580 (250817@main): <https://commits.webkit.org/250817@main>

Reviewed commits have been landed. Closing PR #856 and removing active labels.
Comment 5 Karl Rackler 2022-05-23 09:28:43 PDT
These tests are also affected.

Description:
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r32f-red-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-rgb8-rgb-unsigned_byte.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-rgb9_e5-rgb-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-rgba4-rgba-unsigned_byte.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-rgb16f-rgb-half_float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-3d-srgb8-rgb-unsigned_byte.html


I have marked this test as a flaky failure while investigating this issue.
Comment 6 Karl Rackler 2022-05-23 09:33:52 PDT
Pull request: https://github.com/WebKit/WebKit/pull/921
Comment 7 EWS 2022-05-23 09:36:37 PDT
Test gardening commit r294648 (250872@main): <https://commits.webkit.org/250872@main>

Reviewed commits have been landed. Closing PR #921 and removing active labels.
Comment 8 Karl Rackler 2022-05-23 10:48:43 PDT
These tests are also affected.

Description:
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r11f_g11f_b10f-rgb-float.html
webgl/2.0.0/conformance2/textures/image_bitmap_from_image_bitmap/tex-2d-r16f-red-half_float.html

I have marked this test as a flaky failure while investigating this issue.
Comment 9 Karl Rackler 2022-05-23 10:51:59 PDT
Pull request: https://github.com/WebKit/WebKit/pull/928
Comment 10 EWS 2022-05-23 10:54:50 PDT
Test gardening commit r294653 (250877@main): <https://commits.webkit.org/250877@main>

Reviewed commits have been landed. Closing PR #928 and removing active labels.
Comment 11 Ryan Haddad 2022-05-23 12:39:27 PDT
Any reason we are not reverting the change since it affects so many tests?
Comment 12 Karl Rackler 2022-05-23 17:54:54 PDT
Thank you for asking the question.  I will reach out to Said early tomorrow morning and revert if he does not have time to work on it. It is up to 20 tests now and I think I have found four more.
Comment 13 Karl Rackler 2022-05-24 07:37:10 PDT
These tests are also affected.

Description:
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-canvas.html
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-pattern-canvas.html

This brings the total tests affected to 24.
Comment 14 Said Abou-Hallawa 2022-05-25 16:20:31 PDT
These tests are constantly passing with the fix of bug 240802.

*** This bug has been marked as a duplicate of bug 240802 ***