Bug 271423

Summary:	New Test (243951@main): [ macOS wk1 arm64 ] 3 imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/ tests are a consistent failure
Product:	WebKit	Reporter:	Karl Rackler <rackler>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Karl Rackler 2024-03-21 15:48:00 PDT

Description:
imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation.html
imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation_none.html
imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/imagebitmap-replication-exif-orientation.html

The test was added at 243951@main and has been a consistent failure on Sonoma wk1 arm64 since its bring up.

This issue can be reproduced using the command: 
run-webkit-tests --release -1 --no-retry --force --iterations=1 imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation.html imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation_none.html imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/imagebitmap-replication-exif-orientation.html

Result: 
Regressions: Unexpected text-only failures (3)
  imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation.html [ Failure ]
  imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation_none.html [ Failure ]
  imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/imagebitmap-replication-exif-orientation.html [ Failure ]

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-exif-orientation.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-exif-orientation_none.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2Fimagebitmap-replication-exif-orientation.html&version_name=Sonoma&architecture=arm64&flavor=wk1&recent=false

Diff:
--- /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation-expected.txt
+++ /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation-actual.txt
@@ -1,6 +1,6 @@
 
-PASS createImageBitmap with EXIF rotation, imageOrientation from-image, and no cropping
-PASS createImageBitmap with EXIF rotation, imageOrientation flipY, and no cropping
-PASS createImageBitmap with EXIF rotation, imageOrientation from-image, and cropping
-PASS createImageBitmap with EXIF rotation, imageOrientation flipY, and cropping
+FAIL createImageBitmap with EXIF rotation, imageOrientation from-image, and no cropping assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL createImageBitmap with EXIF rotation, imageOrientation flipY, and no cropping assert_array_approx_equals: Pixel value at (200,40) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL createImageBitmap with EXIF rotation, imageOrientation from-image, and cropping assert_array_approx_equals: Pixel value at (120,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL createImageBitmap with EXIF rotation, imageOrientation flipY, and cropping assert_array_approx_equals: Pixel value at (120,40) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253

--- /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation_none-expected.txt
+++ /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-exif-orientation_none-actual.txt
@@ -1,10 +1,10 @@
 
-PASS createImageBitmap with Orientation 1
+FAIL createImageBitmap with Orientation 1 assert_array_approx_equals: Pixel value at (90,90) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
 FAIL createImageBitmap with Orientation 2 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 128,128,128,255. property 0, expected 0 +/- 1, expected 0 but got 128
-FAIL createImageBitmap with Orientation 3 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,128,129,255. property 0, expected 0 +/- 1, expected 0 but got 254
+FAIL createImageBitmap with Orientation 3 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,128,128,255. property 0, expected 0 +/- 1, expected 0 but got 254
 FAIL createImageBitmap with Orientation 4 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,0,0,255. property 0, expected 0 +/- 1, expected 0 but got 254
 FAIL createImageBitmap with Orientation 5 assert_array_approx_equals: Pixel value at (90,10) 128,128,128,255 =~ 0,255,1,255. property 0, expected 128 +/- 1, expected 128 but got 0
 FAIL createImageBitmap with Orientation 6 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,0,0,255. property 0, expected 0 +/- 1, expected 0 but got 254
-FAIL createImageBitmap with Orientation 7 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,128,129,255. property 0, expected 0 +/- 1, expected 0 but got 254
+FAIL createImageBitmap with Orientation 7 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 254,128,128,255. property 0, expected 0 +/- 1, expected 0 but got 254
 FAIL createImageBitmap with Orientation 8 assert_array_approx_equals: Pixel value at (10,10) 0,0,0,255 =~ 128,128,128,255. property 0, expected 0 +/- 1, expected 0 but got 128
 
--- /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/imagebitmap-replication-exif-orientation-expected.txt
+++ /Volumes/Data/worker/Apple-Sonoma-Release-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/imagebitmap-replication-exif-orientation-actual.txt
@@ -1,11 +1,11 @@
 
 
-PASS ImageBitmap from file with EXIF rotation, duplicated via structuredClone
-PASS ImageBitmap from file with EXIF rotation, loaded via <img>
-PASS ImageBitmap from file with EXIF rotation, loaded via <img> not in DOM, imageOrientation = none
+FAIL ImageBitmap from file with EXIF rotation, duplicated via structuredClone assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL ImageBitmap from file with EXIF rotation, loaded via <img> assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL ImageBitmap from file with EXIF rotation, loaded via <img> not in DOM, imageOrientation = none assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
 FAIL ImageBitmap from file with EXIF rotation, loaded via <img> in DOM, imageOrientation = none assert_equals: Bitmap width expected 320 but got 160
-PASS ImageBitmap from file with EXIF rotation, duplicated via createImageBitmap
-PASS ImageBitmap from file with EXIF rotation, duplicated via worker serialization round-trip
-PASS ImageBitmap from file with EXIF rotation, duplicated via worker transfer round-trip
-PASS ImageBitmap from file with EXIF rotation, duplicated via worker transfer round-trip, while referenced by a CanvasPattern
+FAIL ImageBitmap from file with EXIF rotation, duplicated via createImageBitmap assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL ImageBitmap from file with EXIF rotation, duplicated via worker serialization round-trip assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL ImageBitmap from file with EXIF rotation, duplicated via worker transfer round-trip assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253
+FAIL ImageBitmap from file with EXIF rotation, duplicated via worker transfer round-trip, while referenced by a CanvasPattern assert_array_approx_equals: Pixel value at (200,120) 128,128,255,255 =~ 128,127,253,255. property 2, expected 255 +/- 1, expected 255 but got 253

Comment 1 Radar WebKit Bug Importer 2024-03-21 15:48:19 PDT

<rdar://problem/125197896>

Comment 2 Karl Rackler 2024-03-21 16:08:21 PDT

I have marked these tests as a flaky failure while this issue is investigated.

Comment 3 EWS 2024-03-21 16:09:14 PDT

Test gardening commit 276503@main (c788ec292bd4): <https://commits.webkit.org/276503@main>

Reviewed commits have been landed. Closing PR #26277 and removing active labels.