NEW 235681
REGRESSION (01/14/22?): [macOS Release WK2] imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html and createImageBitmap-flipY.html are flaky failures
https://bugs.webkit.org/show_bug.cgi?id=235681
Summary REGRESSION (01/14/22?): [macOS Release WK2] imported/w3c/web-platform-tests/h...
Ryan Haddad
Reported 2022-01-26 16:47:06 PST
The following tests are flaky failures on macOS Release WK2 bots: imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage.html imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY.html https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-drawImage.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fimagebitmap%2FcreateImageBitmap-flipY.html --- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-expected.txt +++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-drawImage-actual.txt @@ -6,9 +6,9 @@ PASS createImageBitmap from an HTMLCanvasElement with negative sw/sh, and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement, and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement scaled down, and drawImage on the created ImageBitmap -PASS createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap +FAIL createImageBitmap from an HTMLVideoElement scaled up, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (10, 10) expected 247 +/- 3 but got 242 PASS createImageBitmap from an HTMLVideoElement resized, and drawImage on the created ImageBitmap -PASS createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap +FAIL createImageBitmap from an HTMLVideoElement with negative sw/sh, and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 247 +/- 3 but got 242 PASS createImageBitmap from an HTMLVideoElement from a data URL, and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement from a data URL scaled down, and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement from a data URL scaled up, and drawImage on the created ImageBitmap --- /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-expected.txt +++ /Volumes/Data/worker/macOS-Catalina-Release-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/imagebitmap/createImageBitmap-flipY-actual.txt @@ -2,7 +2,7 @@ PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "none", and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLCanvasElement imageOrientation: "flipY", and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement imageOrientation: "none", and drawImage on the created ImageBitmap -PASS createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap +FAIL createImageBitmap from an HTMLVideoElement imageOrientation: "flipY", and drawImage on the created ImageBitmap assert_approx_equals: Red channel of the pixel at (5, 5) expected 28 +/- 3 but got 42 PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "none", and drawImage on the created ImageBitmap PASS createImageBitmap from an HTMLVideoElement from a data URL imageOrientation: "flipY", and drawImage on the created ImageBitmap PASS createImageBitmap from a bitmap HTMLImageElement imageOrientation: "none", and drawImage on the created ImageBitmap
Attachments
Ryan Haddad
Comment 1 2022-01-26 16:49:57 PST
It looks like these tests had been flaky on Monterey bots, but then started passing consistently. They started failing frequently on Catalina and Big Sur around r 288032 on 01/14/22
Ryan Haddad
Comment 2 2022-01-26 16:57:58 PST
Marked tests as flaky in r288656 to minimize impact on EWS.
Radar WebKit Bug Importer
Comment 3 2022-01-26 17:26:29 PST
Note You need to log in before you can comment on or make changes to this bug.