REGRESSION(iOS 14): webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html is a constant failure

• Component: WebGL
• Status: RESOLVED CONFIGURATION CHANGED

[Hector Lopez]

webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html

Test is a constant failure on iOS according to history. First occurrence matches first recorded testing on iOS 14 from iOS 13. Test was passing on iOS 13 prior to moving over to iOS 14.

History:

https://results.webkit.org/?suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftex-image-and-sub-image-2d-with-video.html&platform=ios

Diff:

--- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video-actual.txt
@@ -1,5 +1,15 @@
 This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL.
 
 Test: ../../resources/webgl_test_files/conformance/textures/tex-image-and-sub-image-2d-with-video.html
-[ PASS ] All tests passed
+[ 1: FAIL ] at (4, 4) expected: 0,255,0 was 0,161,0
+[ 2: FAIL ] at (4, 24) expected: 255,0,0 was 0,134,0
+[ 3: FAIL ] at (4, 4) expected: 255,0,0 was 0,134,0
+[ 4: FAIL ] at (4, 24) expected: 0,255,0 was 0,134,0
+[ 5: PASS ] shouldBe 0,255,0
+[ 6: PASS ] shouldBe 255,0,0
+[ 7: PASS ] shouldBe 255,0,0
+[ 8: PASS ] shouldBe 0,255,0
+[ 9: PASS ] getError was expected value: NO_ERROR : should be no errors
+[ 10: PASS ] successfullyParsed is true
+[ FAIL ] 4 failures reported

Was able to reproduce on latest spade as of the date of this report r267896:

run-webkit-tests webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html  --iterations 1000 --ios-simulator --exit-after-n-failures 3 

Running 1 WebKitTestRunnerApp.app.

[1/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
[2/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
[3/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (997 didn't run):


Regressions: Unexpected text-only failures (1)
  webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html [ Failure ]

[Ryan Haddad]

<rdar://69900323>

[Hector Lopez]

Test expectation while investigated:

https://trac.webkit.org/changeset/267900/webkit

[Dean Jackson]

Seems as if the ANGLE backend with Metal fixes this.