Bug 207141

Summary: REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html is flaky failing
Product: WebKit Reporter: Jacob Uphoff <jacob_uphoff>
Component: CanvasAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: dino, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Update Test Expectations none

Description Jacob Uphoff 2020-02-03 13:24:52 PST 
inspector/canvas/create-context-bitmaprenderer.html

This test has been flaky failing and the first failure was seen on commit 254517 so it probably regressed around there

I ran the test in iterations x5000 and did not reproduce the failure 

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fcanvas%2Fcreate-context-bitmaprenderer.html&limit=50000&platform=ios&platform=mac

Diff:

--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -25,5 +25,5 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
Comment 1 Jacob Uphoff 2020-02-03 13:28:44 PST 
Seems to only be affecting release at this time
Comment 2 Jacob Uphoff 2020-02-03 13:29:01 PST 
Created attachment 389551 [details]
Update Test Expectations
Comment 3 Radar WebKit Bug Importer 2020-02-03 13:32:37 PST 
<rdar://problem/59123309>
Comment 4 Truitt Savell 2020-02-03 13:33:10 PST 
Comment on attachment 389551 [details]
Update Test Expectations

Clearing flags on attachment: 389551

Committed r255585: <https://trac.webkit.org/changeset/255585>
Comment 5 Ryan Haddad 2021-07-09 15:21:49 PDT 
This test is still a flaky failure, seems to be limited to debug bots:

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -14,7 +14,7 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
 
 -- Running test case: Canvas.CreateContextBitmapRenderer.Detached
 PASS: Canvas context should be Bitmap Renderer.
@@ -25,5 +25,8 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
+FAIL: Removed canvas has expected ID.
+    Expected: "canvas:0.76"
+    Actual: "canvas:0.77"
 PASS: Removed canvas has expected ID.
Comment 6 Ryan Haddad 2021-07-09 15:31:15 PDT 
Updated expectations to reflect that this is debug only now in https://trac.webkit.org/changeset/279798/webkit