Bug 229829 - [ iOS & Win ] css3/filters/canvas-with-filter-after-repaint.html is flaky image failing
Summary: [ iOS & Win ] css3/filters/canvas-with-filter-after-repaint.html is flaky ima...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: CSS (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-09-02 14:24 PDT by ayumi_kojima
Modified: 2021-09-13 17:14 PDT (History)
7 users (show)

See Also:


Attachments
Image diff (15.22 KB, image/png)
2021-09-02 14:25 PDT, ayumi_kojima
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-09-02 14:24:16 PDT
css3/filters/canvas-with-filter-after-repaint.html 

Is flaky image failing on iOS 14 E and Windows. The flaky failure is also seen on the EWS.

History: https://results.webkit.org/?suite=layout-tests&test=css3/filters/canvas-with-filter-after-repaint.html

Result page: https://build.webkit.org/results/Apple-iOS-14-Simulator-Release-WK2-Tests/r281930%20(3056)/results.html
Comment 1 ayumi_kojima 2021-09-02 14:25:42 PDT
Created attachment 437199 [details]
Image diff
Comment 2 ayumi_kojima 2021-09-02 14:28:28 PDT
Of three test runners for Windows in the history, it seems there are already test expectation set to pass image failure for two of them. I was not able to find test expectations or associated but for this.
Comment 3 Radar WebKit Bug Importer 2021-09-02 14:32:53 PDT
<rdar://problem/82693742>
Comment 4 ayumi_kojima 2021-09-02 14:37:18 PDT
Marked expectations for iOS and Windows: https://trac.webkit.org/changeset/281954/webkit
Comment 5 Alexey Proskuryakov 2021-09-05 14:19:15 PDT
According to actual result, the test is outright failing - the expectation is that the canvas should be blank, and it is not.
Comment 6 ayumi_kojima 2021-09-13 17:05:26 PDT
I was able to reproduce the image failure at TOT locally using run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.

The test failed at r280544, but it didn't run at r280543. I can think that the test has been failing since it was added at https://trac.webkit.org/changeset/280543/webkit
Comment 7 Wenson Hsieh 2021-09-13 17:14:28 PDT
(In reply to ayumi_kojima from comment #6)
> I was able to reproduce the image failure at TOT locally using
> run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force
> css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.
> 
> The test failed at r280544, but it didn't run at r280543. I can think that
> the test has been failing since it was added at
> https://trac.webkit.org/changeset/280543/webkit

I can reproduce in iOS simulator as well, but not on actual hardware. (Though I'm not sure what's going on with Windows).

Another (similar) version of this test case is also available at https://whsieh.github.io/examples/canvas-filter-simple, and the same problem reproduces for me when testing in iOS sim manually (but not on device).

I suspect this is specific to the simulator...