Bug 207141 - REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html is flaky failing
Summary: REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Canvas (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-03 13:24 PST by Jacob Uphoff
Modified: 2021-07-09 15:31 PDT (History)
4 users (show)

See Also:


Attachments
Update Test Expectations (1.45 KB, patch)
2020-02-03 13:29 PST, Jacob Uphoff
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Jacob Uphoff 2020-02-03 13:24:52 PST
inspector/canvas/create-context-bitmaprenderer.html

This test has been flaky failing and the first failure was seen on commit 254517 so it probably regressed around there

I ran the test in iterations x5000 and did not reproduce the failure 

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fcanvas%2Fcreate-context-bitmaprenderer.html&limit=50000&platform=ios&platform=mac

Diff:

--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -25,5 +25,5 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
Comment 1 Jacob Uphoff 2020-02-03 13:28:44 PST
Seems to only be affecting release at this time
Comment 2 Jacob Uphoff 2020-02-03 13:29:01 PST
Created attachment 389551 [details]
Update Test Expectations
Comment 3 Radar WebKit Bug Importer 2020-02-03 13:32:37 PST
<rdar://problem/59123309>
Comment 4 Truitt Savell 2020-02-03 13:33:10 PST
Comment on attachment 389551 [details]
Update Test Expectations

Clearing flags on attachment: 389551

Committed r255585: <https://trac.webkit.org/changeset/255585>
Comment 5 Ryan Haddad 2021-07-09 15:21:49 PDT
This test is still a flaky failure, seems to be limited to debug bots:

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -14,7 +14,7 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
 
 -- Running test case: Canvas.CreateContextBitmapRenderer.Detached
 PASS: Canvas context should be Bitmap Renderer.
@@ -25,5 +25,8 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
+FAIL: Removed canvas has expected ID.
+    Expected: "canvas:0.76"
+    Actual: "canvas:0.77"
 PASS: Removed canvas has expected ID.
Comment 6 Ryan Haddad 2021-07-09 15:31:15 PDT
Updated expectations to reflect that this is debug only now in https://trac.webkit.org/changeset/279798/webkit