Bug 206752 - [iOS wk2 release and Mac] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html flaky failure
Summary: [iOS wk2 release and Mac] imported/w3c/web-platform-tests/2dcontext/imagebitm...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-01-24 09:12 PST by Jason Lawrence
Modified: 2020-02-13 09:58 PST (History)
4 users (show)

See Also:


Attachments
Update Test Expectations (2.44 KB, patch)
2020-01-28 10:46 PST, Jason Lawrence
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-01-24 09:12:52 PST
imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html 

Description:
This test is flaky failing in iOS wk2 release and Mac.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2F2dcontext%2Fimagebitmap%2FcreateImageBitmap-serializable.html

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable-actual.txt
@@ -1,4 +1,3 @@
-CONSOLE MESSAGE: line 2: TypeError: Type error
 
 PASS Serialize ImageBitmap created from an HTMLCanvasElement 
 PASS Serialize ImageBitmap created from an HTMLVideoElement
Comment 1 Radar WebKit Bug Importer 2020-01-24 09:13:16 PST
<rdar://problem/58869582>
Comment 2 Jason Lawrence 2020-01-24 10:57:50 PST
This looks like it may have regressed around 254399.
Comment 3 Darin Adler 2020-01-25 08:11:01 PST
r254399 is when a new version of this test and its expected result was first landed, so there’s no reason to think this became more flaky because of a software change. It’s just that the new part of the test is flaky. And what seems flaky is the question of whether a type error is logged to the console.

I wish I knew more about where the type error was coming from, even which JavaScript source file.
Comment 4 Jason Lawrence 2020-01-28 10:46:27 PST
Created attachment 389031 [details]
Update Test Expectations
Comment 5 Truitt Savell 2020-01-28 10:48:47 PST
Comment on attachment 389031 [details]
Update Test Expectations

Clearing flags on attachment: 389031

Committed r255259: <https://trac.webkit.org/changeset/255259>
Comment 6 Jason Lawrence 2020-02-13 09:58:53 PST
I am able to reproduce this issue with r256503 using the command below.
run-webkit-tests imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html --iterations 3000 --exit-after-n-failures 5 --force -f

18/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[24/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[26/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[27/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[32/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
Exiting early after 5 failures. 27 tests run.

22 tests ran as expected, 5 didn't (2973 didn't run):