Bug 229829 – [ iOS & Win ] css3/filters/canvas-with-filter-after-repaint.html is flaky image failing

• Component: CSS
• Status: RESOLVED CONFIGURATION CHANGED

css3/filters/canvas-with-filter-after-repaint.html 

Is flaky image failing on iOS 14 E and Windows. The flaky failure is also seen on the EWS.

History: https://results.webkit.org/?suite=layout-tests&test=css3/filters/canvas-with-filter-after-repaint.html

Result page: https://build.webkit.org/results/Apple-iOS-14-Simulator-Release-WK2-Tests/r281930%20(3056)/results.html

Created attachment 437199 [details]
Image diff

Of three test runners for Windows in the history, it seems there are already test expectation set to pass image failure for two of them. I was not able to find test expectations or associated but for this.

[Radar WebKit Bug Importer]

<rdar://problem/82693742>

Marked expectations for iOS and Windows: https://trac.webkit.org/changeset/281954/webkit

[Alexey Proskuryakov]

According to actual result, the test is outright failing - the expectation is that the canvas should be blank, and it is not.

I was able to reproduce the image failure at TOT locally using run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.

The test failed at r280544, but it didn't run at r280543. I can think that the test has been failing since it was added at https://trac.webkit.org/changeset/280543/webkit

[Wenson Hsieh]

(In reply to ayumi_kojima from comment #6)
> I was able to reproduce the image failure at TOT locally using
> run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force
> css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.
> 
> The test failed at r280544, but it didn't run at r280543. I can think that
> the test has been failing since it was added at
> https://trac.webkit.org/changeset/280543/webkit

I can reproduce in iOS simulator as well, but not on actual hardware. (Though I'm not sure what's going on with Windows).

Another (similar) version of this test case is also available at https://whsieh.github.io/examples/canvas-filter-simple, and the same problem reproduces for me when testing in iOS sim manually (but not on device).

I suspect this is specific to the simulator...

[Brent Fulgham]

Wenson confirmed this is no longer happening (3/8/2022).