Bug 229043

Summary: [ MacOS EWS ] 3 inspector/canvas/* tests are flaky failing/ crashing
Product: WebKit Reporter: ayumi_kojima
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: mmaxfield, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=228216
https://bugs.webkit.org/show_bug.cgi?id=227881

Description ayumi_kojima 2021-08-12 10:53:16 PDT
inspector/canvas/recording-webgl-snapshots.html

Is flaky failing on Big Sur AppleSilicon Debug wk2 EWS and Catalina Release wk2 EWS.

The failure is seen on the open source directory as well: https://results.webkit.org/?suite=layout-tests&test=inspector/canvas/recording-webgl-snapshots.html
Comment 1 ayumi_kojima 2021-08-12 11:07:13 PDT
Diff: 

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-actual.txt
@@ -41,7 +41,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     3: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -62,7 +62,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     5: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -83,7 +83,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     7: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -114,7 +114,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     10: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -135,5 +135,5 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
Comment 2 Radar WebKit Bug Importer 2021-08-12 11:07:39 PDT
<rdar://problem/81858079>
Comment 3 ayumi_kojima 2021-08-12 11:10:36 PDT
It appears to have started at around https://ews-build.webkit.org/#/builders/60/builds/6863
Comment 4 ayumi_kojima 2021-08-12 13:43:00 PDT
There was a bug about this flaky failure https://bugs.webkit.org/show_bug.cgi?id=227881 that's fixed at https://trac.webkit.org/changeset/280418/webkit. However, the flaky failure continues to show up after this fix on the open source.

I was not able to reproduce the failure as I currently do not have access to working testing environments.
Comment 5 ayumi_kojima 2021-08-12 13:51:30 PDT
Updated test expectations while investigating https://trac.webkit.org/changeset/280985/webkit
Comment 6 ayumi_kojima 2021-08-12 16:00:47 PDT
inspector/canvas/recording-bitmaprenderer-frameCount.html
inspector/canvas/recording-2d-full.html

Are also flaky failing/ crashing on the open source. Also showing up on EWS as flaky tests.
Comment 7 ayumi_kojima 2021-08-12 16:03:11 PDT
Updated test expectations for the two tests https://trac.webkit.org/changeset/280990/webkit