Bug 235681 - REGRESSION (01/14/22?): [macOS Release WK2] imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html and createImageBitmap-flipY.html are flaky failures
Summary: REGRESSION (01/14/22?): [macOS Release WK2] imported/w3c/web-platform-tests/h...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-01-26 16:47 PST by Ryan Haddad
Modified: 2022-01-28 09:24 PST (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2022-01-26 16:47:06 PST
The following tests are flaky failures on macOS Release WK2 bots:

imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html
imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY.html

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-drawImage.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-flipY.html

--- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-expected.txt
+++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-actual.txt
@@ -6,9 +6,9 @@
 PASS createImageBitmap from an HTMLCanvasElement with negative sw/sh, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement scaled down, and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (10, 10) expected 247 +/- 3 but got 242
 PASS createImageBitmap from an HTMLVideoElement resized, and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 247 +/- 3 but got 242
 PASS createImageBitmap from an HTMLVideoElement from a data URL, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL scaled down, and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL scaled up, and drawImage on the created ImageBitmap

--- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-expected.txt
+++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-actual.txt
@@ -2,7 +2,7 @@
 PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "none", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "flipY", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement imageOrientation: "none", and drawImage on the created ImageBitmap
-PASS createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap
+FAIL createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 28 +/- 3 but got 42
 PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "none", and drawImage on the created ImageBitmap
 PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "flipY", and drawImage on the created ImageBitmap
 PASS createImageBitmap from a bitmap HTMLImageElement imageOrientation: "none", and drawImage on the created ImageBitmap
Comment 1 Ryan Haddad 2022-01-26 16:49:57 PST
It looks like these tests had been flaky on Monterey bots, but then started passing consistently. They started failing frequently on Catalina and Big Sur around r 288032 on 01/14/22
Comment 2 Ryan Haddad 2022-01-26 16:57:58 PST
Marked tests as flaky in r288656 to minimize impact on EWS.
Comment 3 Radar WebKit Bug Importer 2022-01-26 17:26:29 PST
<rdar://problem/88104411>