Bug 207141 – REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html is flaky failing

• Status: NEW
• Component: Canvas

[Jacob Uphoff]

inspector/canvas/create-context-bitmaprenderer.html

This test has been flaky failing and the first failure was seen on commit 254517 so it probably regressed around there

I ran the test in iterations x5000 and did not reproduce the failure 

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fcanvas%2Fcreate-context-bitmaprenderer.html&limit=50000&platform=ios&platform=mac

Diff:

--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -25,5 +25,5 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms

[Jacob Uphoff]

Seems to only be affecting release at this time

[Jacob Uphoff]

Created attachment 389551 [details]
Update Test Expectations

[Radar WebKit Bug Importer]

<rdar://problem/59123309>

[Truitt Savell]

Comment on attachment 389551 [details]
Update Test Expectations

Clearing flags on attachment: 389551

Committed r255585: <https://trac.webkit.org/changeset/255585>

[Ryan Haddad]

This test is still a flaky failure, seems to be limited to debug bots:

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -14,7 +14,7 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
 
 -- Running test case: Canvas.CreateContextBitmapRenderer.Detached
 PASS: Canvas context should be Bitmap Renderer.
@@ -25,5 +25,8 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
+FAIL: Removed canvas has expected ID.
+    Expected: "canvas:0.76"
+    Actual: "canvas:0.77"
 PASS: Removed canvas has expected ID.

[Ryan Haddad]

Updated expectations to reflect that this is debug only now in https://trac.webkit.org/changeset/279798/webkit