241048 2022-05-27 15:36:46 -0700 [ iOS macOS ] two imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage tests are a consistent failure 2022-07-20 22:20:56 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 rackler rackler heycam jer.noble webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1872445 0 rackler 2022-05-27 15:36:46 -0700 Description: imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html The first failure that I saw on the dashboard for Big Sur was on 2/15/2022 at r289815. The first failure for Monterey was on 3/17/2022 at r291428. The first failure for iOS was on 12/21/2021 at r287308. These tests have been flaky or consistent failures for their entire history on the dashboard. iOS, Big Sur, and Monterey wk1 have been consistent failures. Monterey wk1 is also a flaky timeout. Monterey wk2 has been a flaky failure. REPRODUCTION STEPS I can reproduce this on ToT. Command: [ iOS ] consistent failure ToT 294933 run-webkit-tests --ios-simulator --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 --no-retry --force --no-build imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html [ Monterey wk1 ] consistent failure or timeout ToT 294943 Regressions: Unexpected timeouts (1) run-webkit-tests --root 294943 -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html [ Monterey wk2 ] flaky failure ToT 294943 run-webkit-tests --root 294943 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html Result: [ iOS ] consistent failure ToT 294933 Regressions: Unexpected text-only failures (1) imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html [ Failure ] [ Monterey wk1 ] consistent failure or timeout ToT 294943 Regressions: Unexpected timeouts (1) imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html [ Timeout ] [ Monterey wk2 ] flaky failure ToT 294943 Regressions: Unexpected text-only failures (1) imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html [ Failure ] History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fwide-gamut-canvas%2Fcanvas-display-p3-drawImage-video.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fwide-gamut-canvas%2Fcanvas-draw-high-bit-depth-images.html&limit=50000&platform=ios&platform=mac Diff: --- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video-expected.txt +++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video-actual.txt @@ -1,19 +1,22 @@ + + +Harness Error (TIMEOUT), message = null PASS sRGB-FF0100, Context srgb, ImageData srgb, cropSource=false -PASS sRGB-FF0100, Context srgb, ImageData srgb, cropSource=true +TIMEOUT sRGB-FF0100, Context srgb, ImageData srgb, cropSource=true Test timed out PASS sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=false -PASS sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=true -PASS sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=false +TIMEOUT sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=true Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=false Test timed out PASS sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=true -PASS sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=false -PASS sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=true -PASS sRGB-BB0000, Context srgb, ImageData srgb, cropSource=false +TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=false Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=true Test timed out +TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, cropSource=false Test timed out PASS sRGB-BB0000, Context srgb, ImageData srgb, cropSource=true PASS sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=false -PASS sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=true +TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=true Test timed out PASS sRGB-BB0000, Context display-p3, ImageData srgb, cropSource=false PASS sRGB-BB0000, Context display-p3, ImageData srgb, cropSource=true -PASS sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=false +TIMEOUT sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=false Test timed out PASS sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=true PASS Rec2020-3FF000000, Context srgb, ImageData srgb, cropSource=false PASS Rec2020-3FF000000, Context srgb, ImageData srgb, cropSource=true --- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video-expected.txt +++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video-actual.txt @@ -1,20 +1,23 @@ -PASS sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=false + +Harness Error (TIMEOUT), message = null + +TIMEOUT sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=false Test timed out PASS sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=true PASS sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=false -PASS sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=true -PASS sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=false -PASS sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=true -PASS sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=false -PASS sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=true -PASS sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=false -PASS sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=true -PASS sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=false -PASS sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=true -PASS sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=false +TIMEOUT sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=true Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=false Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=true Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=false Test timed out +TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=true Test timed out +TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=false Test timed out +TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=true Test timed out +TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=false Test timed out +TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=true Test timed out +TIMEOUT sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=false Test timed out PASS sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=true PASS sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=false -PASS sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=true +TIMEOUT sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=true Test timed out PASS Rec2020-3FF000000, Context srgb, ImageData srgb, scaleImage=false PASS Rec2020-3FF000000, Context srgb, ImageData srgb, scaleImage=true PASS Rec2020-3FF000000, Context srgb, ImageData display-p3, scaleImage=false 1872446 1 webkit-bug-importer 2022-05-27 15:37:16 -0700 <rdar://problem/94056966> 1872452 2 rackler 2022-05-27 15:55:56 -0700 I have marked these tests as flaky failures or timeouts while this issue is investigated. 1872454 3 rackler 2022-05-27 15:57:46 -0700 Pull request: https://github.com/WebKit/WebKit/pull/1126 1872455 4 ews-feeder 2022-05-27 16:00:30 -0700 Test gardening commit r294962 (251066@main): <https://commits.webkit.org/251066@main> Reviewed commits have been landed. Closing PR #1126 and removing active labels. 1885273 5 heycam 2022-07-19 19:01:16 -0700 https://github.com/WebKit/WebKit/pull/2574 1885563 6 ews-feeder 2022-07-20 22:20:54 -0700 Committed 252686@main (6f74311b11e5): <https://commits.webkit.org/252686@main> Reviewed commits have been landed. Closing PR #2574 and removing active labels.