Bug 235681

Summary:	REGRESSION (01/14/22?): [macOS Release WK2] imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html and createImageBitmap-flipY.html are flaky failures
Product:	WebKit	Reporter:	Ryan Haddad <ryanhaddad>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	eric.carlson, jer.noble, sabouhallawa, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=248067

Description Ryan Haddad 2022-01-26 16:47:06 PST

The following tests are flaky failures on macOS Release WK2 bots:

imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html
imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY.html

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-drawImage.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-flipY.html

--- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-expected.txt
+++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-actual.txt
@@ -6,9 +6,9 @@
 PASS createImageBitmap from an HTMLCanvasElement with negative sw/sh, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement scaled down, and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (10, 10) expected 247 +/- 3 but got 242
 PASS createImageBitmap from an HTMLVideoElement resized, and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 247 +/- 3 but got 242
 PASS createImageBitmap from an HTMLVideoElement from a data URL, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL scaled down, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL scaled up, and drawImage on the created ImageBitmap

--- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-expected.txt
+++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-actual.txt
@@ -2,7 +2,7 @@
 PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "none", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "flipY", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement imageOrientation: "none", and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 28 +/- 3 but got 42
 PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "none", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "flipY", and drawImage on the created ImageBitmap
 PASS createImageBitmap from a bitmap HTMLImageElement imageOrientation: "none", and drawImage on the created ImageBitmap

Comment 1 Ryan Haddad 2022-01-26 16:49:57 PST

It looks like these tests had been flaky on Monterey bots, but then started passing consistently. They started failing frequently on Catalina and Big Sur around r 288032 on 01/14/22

Comment 2 Ryan Haddad 2022-01-26 16:57:58 PST

Marked tests as flaky in r288656 to minimize impact on EWS.

Comment 3 Radar WebKit Bug Importer 2022-01-26 17:26:29 PST

<rdar://problem/88104411>