Bug 229043 - [ MacOS EWS ] 3 inspector/canvas/* tests are flaky failing/ crashing
Summary: [ MacOS EWS ] 3 inspector/canvas/* tests are flaky failing/ crashing
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-08-12 10:53 PDT by ayumi_kojima
Modified: 2021-08-12 16:03 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-08-12 10:53:16 PDT 
inspector/canvas/recording-webgl-snapshots.html

Is flaky failing on Big Sur AppleSilicon Debug wk2 EWS and Catalina Release wk2 EWS.

The failure is seen on the open source directory as well: https://results.webkit.org/?suite=layout-tests&test=inspector/canvas/recording-webgl-snapshots.html
Comment 1 ayumi_kojima 2021-08-12 11:07:13 PDT 
Diff: 

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/recording-webgl-snapshots-actual.txt
@@ -41,7 +41,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     3: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -62,7 +62,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     5: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -83,7 +83,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     7: bufferData(34962, 0, 35044)
       swizzleTypes: [Number, TypedArray, Number]
       trace:
@@ -114,7 +114,7 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
     10: clearColor(0, 0, 0, 1)
       swizzleTypes: [Number, Number, Number, Number]
       trace:
@@ -135,5 +135,5 @@
         4: evaluateWithScopeExtension
         5: (anonymous function)
         6: _wrapCall
-      snapshot: <PASS: content changed>
+      snapshot: <FAIL: content changed>
Comment 2 Radar WebKit Bug Importer 2021-08-12 11:07:39 PDT 
<rdar://problem/81858079>
Comment 3 ayumi_kojima 2021-08-12 11:10:36 PDT 
It appears to have started at around https://ews-build.webkit.org/#/builders/60/builds/6863
Comment 4 ayumi_kojima 2021-08-12 13:43:00 PDT 
There was a bug about this flaky failure https://bugs.webkit.org/show_bug.cgi?id=227881 that's fixed at https://trac.webkit.org/changeset/280418/webkit. However, the flaky failure continues to show up after this fix on the open source.

I was not able to reproduce the failure as I currently do not have access to working testing environments.
Comment 5 ayumi_kojima 2021-08-12 13:51:30 PDT 
Updated test expectations while investigating https://trac.webkit.org/changeset/280985/webkit
Comment 6 ayumi_kojima 2021-08-12 16:00:47 PDT 
inspector/canvas/recording-bitmaprenderer-frameCount.html
inspector/canvas/recording-2d-full.html

Are also flaky failing/ crashing on the open source. Also showing up on EWS as flaky tests.
Comment 7 ayumi_kojima 2021-08-12 16:03:11 PDT 
Updated test expectations for the two tests https://trac.webkit.org/changeset/280990/webkit