Bug 217257 - REGRESSION(iOS 14): webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html is a constant failure
Summary: REGRESSION(iOS 14): webgl/1.0.3/conformance/textures/tex-image-and-sub-image-...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebGL (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-10-02 15:53 PDT by Hector Lopez
Modified: 2022-02-12 19:29 PST (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hector Lopez 2020-10-02 15:53:44 PDT
webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html

Test is a constant failure on iOS according to history. First occurrence matches first recorded testing on iOS 14 from iOS 13. Test was passing on iOS 13 prior to moving over to iOS 14.

History:

https://results.webkit.org/?suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Ftextures%2Ftex-image-and-sub-image-2d-with-video.html&platform=ios

Diff:

--- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video-actual.txt
@@ -1,5 +1,15 @@
 This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL.
 
 Test: ../../resources/webgl_test_files/conformance/textures/tex-image-and-sub-image-2d-with-video.html
-[ PASS ] All tests passed
+[ 1: FAIL ] at (4, 4) expected: 0,255,0 was 0,161,0
+[ 2: FAIL ] at (4, 24) expected: 255,0,0 was 0,134,0
+[ 3: FAIL ] at (4, 4) expected: 255,0,0 was 0,134,0
+[ 4: FAIL ] at (4, 24) expected: 0,255,0 was 0,134,0
+[ 5: PASS ] shouldBe 0,255,0
+[ 6: PASS ] shouldBe 255,0,0
+[ 7: PASS ] shouldBe 255,0,0
+[ 8: PASS ] shouldBe 0,255,0
+[ 9: PASS ] getError was expected value: NO_ERROR : should be no errors
+[ 10: PASS ] successfullyParsed is true
+[ FAIL ] 4 failures reported

Was able to reproduce on latest spade as of the date of this report r267896:

run-webkit-tests webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html  --iterations 1000 --ios-simulator --exit-after-n-failures 3 

Running 1 WebKitTestRunnerApp.app.

[1/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
[2/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
[3/1000] webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html failed unexpectedly (text diff)
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (997 didn't run):


Regressions: Unexpected text-only failures (1)
  webgl/1.0.3/conformance/textures/tex-image-and-sub-image-2d-with-video.html [ Failure ]
Comment 1 Ryan Haddad 2020-10-02 16:09:35 PDT
<rdar://69900323>
Comment 2 Hector Lopez 2020-10-02 16:25:27 PDT
Test expectation while investigated:

https://trac.webkit.org/changeset/267900/webkit
Comment 3 Dean Jackson 2021-03-03 13:59:52 PST
Seems as if the ANGLE backend with Metal fixes this.