Bug 229043

Summary:	[ MacOS EWS ] 3 inspector/canvas/* tests are flaky failing/ crashing
Product:	WebKit	Reporter:	ayumi_kojima
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	mmaxfield, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=228216 https://bugs.webkit.org/show_bug.cgi?id=227881

Description ayumi_kojima 2021-08-12 10:53:16 PDT

inspector/canvas/recording-webgl-snapshots.html

Is flaky failing on Big Sur AppleSilicon Debug wk2 EWS and Catalina Release wk2 EWS.

The failure is seen on the open source directory as well: https://results.webkit.org/?suite=layout-tests&test=inspector/canvas/recording-webgl-snapshots.html

Comment 1 ayumi_kojima 2021-08-12 11:07:13 PDT

Diff: 

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-actual.txt
@@ -41,7 +41,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     3: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -62,7 +62,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     5: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -83,7 +83,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     7: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -114,7 +114,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     10: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -135,5 +135,5 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>

Comment 2 Radar WebKit Bug Importer 2021-08-12 11:07:39 PDT

<rdar://problem/81858079>

Comment 3 ayumi_kojima 2021-08-12 11:10:36 PDT

It appears to have started at around https://ews-build.webkit.org/#/builders/60/builds/6863

Comment 4 ayumi_kojima 2021-08-12 13:43:00 PDT

There was a bug about this flaky failure https://bugs.webkit.org/show_bug.cgi?id=227881 that's fixed at https://trac.webkit.org/changeset/280418/webkit. However, the flaky failure continues to show up after this fix on the open source.

I was not able to reproduce the failure as I currently do not have access to working testing environments.

Comment 5 ayumi_kojima 2021-08-12 13:51:30 PDT

Updated test expectations while investigating https://trac.webkit.org/changeset/280985/webkit

Comment 6 ayumi_kojima 2021-08-12 16:00:47 PDT

inspector/canvas/recording-bitmaprenderer-frameCount.html
inspector/canvas/recording-2d-full.html

Are also flaky failing/ crashing on the open source. Also showing up on EWS as flaky tests.

Comment 7 ayumi_kojima 2021-08-12 16:03:11 PDT

Updated test expectations for the two tests https://trac.webkit.org/changeset/280990/webkit