REGRESSION (r268115?): [ iOS wk2 EWS ] fast/images/image-orientation-none-canvas.html is a constant failure

• Component: New Bugs
• Status: RESOLVED FIXED

[Karl Rackler]

Description:
fast/images/image-orientation-none-canvas.html

This issue only occurs with iOS wk2 ews and doesn't show up on trunk bots: https://results.webkit.org/?suite=layout-tests&test=fast%2Fimages%2Fimage-orientation-none-canvas.html

The first failure that I see this on the ews queue history was 10/07/20 and failed on clean tree run in https://ews-build.webkit.org/#/builders/24/builds/27591.

Commit r268115 has to do with Refactors TestOptions code in WebKitTestRunne which could have introduced the failures. The change was introduced here https://trac.webkit.org/changeset/268115/webkit.

Reproduced on ews builds: 
https://ews-build.webkit.org/#/builders/24/builds/27591
https://ews-build.webkit.org/#/builders/24/builds/27592
https://ews-build.webkit.org/#/builders/24/builds/27593
https://ews-build.webkit.org/#/builders/24/builds/27595
https://ews-build.webkit.org/#/builders/24/builds/27596
https://ews-build.webkit.org/#/builders/24/builds/27597
https://ews-build.webkit.org/#/builders/24/builds/27599
https://ews-build.webkit.org/#/builders/24/builds/27600
https://ews-build.webkit.org/#/builders/24/builds/27601
https://ews-build.webkit.org/#/builders/24/builds/27602
https://ews-build.webkit.org/#/builders/24/builds/27603
https://ews-build.webkit.org/#/builders/24/builds/27604
https://ews-build.webkit.org/#/builders/24/builds/27605

Result: 
Regressions: Unexpected image-only failures (1)
  fast/images/image-orientation-none-canvas.html [ ImageOnlyFailure ]

Build Example:
https://ews-build.webkit.org/#/builders/24/builds/27604

Queue History:
https://ews-build.webkit.org/#/builders/24

layout-tests test-failures:
fast/images/image-orientation-none-canvas.html

layout-tests stdio:
08:07:39.835 668 [14952/48041] fast/images/image-orientation-none-canvas.html failed unexpectedly (reference mismatch)
08:07:39.834 2557 worker/1 fast/images/image-orientation-none-canvas.html failed:
08:07:39.834 2557 worker/1  reference mismatch

Image results:
https://ews-build.s3-us-west-2.amazonaws.com/iOS-13-Simulator-WK2-Tests-EWS/r410749-27604-rerun/fast/images/image-orientation-none-canvas-diffs.html

[Radar WebKit Bug Importer]

<rdar://problem/70060197>

[Karl Rackler]

I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/268141/webkit

[Karl Rackler]

Revert here: Committed r268143: <https://trac.webkit.org/changeset/268143>
This reverts commit r268115 while investigating ews test
failure.

[Karl Rackler]

Remove test expectation for fast/images/image-orientation-none-canvas.html while the issue is investigated.
https://trac.webkit.org/changeset/268146/webkit

[Alexey Proskuryakov]

Did the revert resolve the problem? Looks like that change was landed again, did the problem start again?

[Ryan Haddad]

We aren't seeing this anymore on recent runs. Moving to resolved.