Bug 229829

Summary: [ iOS & Win ] css3/filters/canvas-with-filter-after-repaint.html is flaky image failing
Product: WebKit Reporter: ayumi_kojima
Component: CSSAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: bfulgham, dino, koivisto, sabouhallawa, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Image diff none

Description ayumi_kojima 2021-09-02 14:24:16 PDT 
css3/filters/canvas-with-filter-after-repaint.html 

Is flaky image failing on iOS 14 E and Windows. The flaky failure is also seen on the EWS.

History: https://results.webkit.org/?suite=layout-tests&test=css3/filters/canvas-with-filter-after-repaint.html

Result page: https://build.webkit.org/results/Apple-iOS-14-Simulator-Release-WK2-Tests/r281930%20(3056)/results.html
Comment 1 ayumi_kojima 2021-09-02 14:25:42 PDT 
Created attachment 437199 [details]
Image diff
Comment 2 ayumi_kojima 2021-09-02 14:28:28 PDT 
Of three test runners for Windows in the history, it seems there are already test expectation set to pass image failure for two of them. I was not able to find test expectations or associated but for this.
Comment 3 Radar WebKit Bug Importer 2021-09-02 14:32:53 PDT 
<rdar://problem/82693742>
Comment 4 ayumi_kojima 2021-09-02 14:37:18 PDT 
Marked expectations for iOS and Windows: https://trac.webkit.org/changeset/281954/webkit
Comment 5 Alexey Proskuryakov 2021-09-05 14:19:15 PDT 
According to actual result, the test is outright failing - the expectation is that the canvas should be blank, and it is not.
Comment 6 ayumi_kojima 2021-09-13 17:05:26 PDT 
I was able to reproduce the image failure at TOT locally using run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.

The test failed at r280544, but it didn't run at r280543. I can think that the test has been failing since it was added at https://trac.webkit.org/changeset/280543/webkit
Comment 7 Wenson Hsieh 2021-09-13 17:14:28 PDT 
(In reply to ayumi_kojima from comment #6)
> I was able to reproduce the image failure at TOT locally using
> run-webkit-tests --iterations 50 --exit-after-n-failures 1 --debug --force
> css3/filters/canvas-with-filter-after-repaint.html --ios-simulator.
> 
> The test failed at r280544, but it didn't run at r280543. I can think that
> the test has been failing since it was added at
> https://trac.webkit.org/changeset/280543/webkit

I can reproduce in iOS simulator as well, but not on actual hardware. (Though I'm not sure what's going on with Windows).

Another (similar) version of this test case is also available at https://whsieh.github.io/examples/canvas-filter-simple, and the same problem reproduces for me when testing in iOS sim manually (but not on device).

I suspect this is specific to the simulator...
Comment 8 Brent Fulgham 2022-06-23 14:10:48 PDT 
Wenson confirmed this is no longer happening (3/8/2022).