Bug 229043 – [ MacOS EWS ] 3 inspector/canvas/* tests are flaky failing/ crashing

• Status: NEW
• Component: New Bugs

inspector/canvas/recording-webgl-snapshots.html

Is flaky failing on Big Sur AppleSilicon Debug wk2 EWS and Catalina Release wk2 EWS.

The failure is seen on the open source directory as well: https://results.webkit.org/?suite=layout-tests&test=inspector/canvas/recording-webgl-snapshots.html

Diff: 

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-actual.txt
@@ -41,7 +41,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     3: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -62,7 +62,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     5: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -83,7 +83,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     7: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -114,7 +114,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     10: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -135,5 +135,5 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>

[Radar WebKit Bug Importer]

<rdar://problem/81858079>

It appears to have started at around https://ews-build.webkit.org/#/builders/60/builds/6863

There was a bug about this flaky failure https://bugs.webkit.org/show_bug.cgi?id=227881 that's fixed at https://trac.webkit.org/changeset/280418/webkit. However, the flaky failure continues to show up after this fix on the open source.

I was not able to reproduce the failure as I currently do not have access to working testing environments.

Updated test expectations while investigating https://trac.webkit.org/changeset/280985/webkit

inspector/canvas/recording-bitmaprenderer-frameCount.html
inspector/canvas/recording-2d-full.html

Are also flaky failing/ crashing on the open source. Also showing up on EWS as flaky tests.

Updated test expectations for the two tests https://trac.webkit.org/changeset/280990/webkit