Bug 266661 – RE-IMPORT(271918@main): [ iOS17 ] 3X imported/w3c/web-platform-tests/css/selectors (layout-tests) are constant text failures

• Status: NEW
• Component: CSS

[Robert Jenner]

The following 3 tests are constant text failures on iOS17:

imported/w3c/web-platform-tests/css/selectors/invalidation/user-valid-user-invalid.html
imported/w3c/web-platform-tests/css/selectors/user-invalid.html
imported/w3c/web-platform-tests/css/selectors/valid-invalid-form-fieldset.html


HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fselectors%2Finvalidation%2Fuser-valid-user-invalid.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fselectors%2Fuser-invalid.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fselectors%2Fvalid-invalid-form-fieldset.html

DIFF URLS:
https://build.webkit.org/results/Apple-iOS-17-Simulator-Release-WK2-Tests/271932@main%20(1083)/imported/w3c/web-platform-tests/css/selectors/invalidation/user-valid-user-invalid-pretty-diff.html
https://build.webkit.org/results/Apple-iOS-17-Simulator-Release-WK2-Tests/271932@main%20(1083)/imported/w3c/web-platform-tests/css/selectors/user-invalid-pretty-diff.html
https://build.webkit.org/results/Apple-iOS-17-Simulator-Release-WK2-Tests/271932@main%20(1083)/imported/w3c/web-platform-tests/css/selectors/valid-invalid-form-fieldset-pretty-diff.html

TEXT DIFFS:
+++ /Volumes/Data/worker/Apple-iOS-17-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/css/selectors/invalidation/user-valid-user-invalid-actual.txt
@@ -1,4 +1,4 @@
 
 
-PASS :user-valid and :user-invalid should invalidate after user input.
+FAIL :user-valid and :user-invalid should invalidate after user input. assert_equals: Invalid input should match :user-invalid. expected "rgb(255, 0, 0)" but got "rgb(255, 255, 255)"
 

+++ /Volumes/Data/worker/Apple-iOS-17-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/css/selectors/user-invalid-actual.txt
@@ -8,4 +8,6 @@
 FAIL :user-invalid selector should respond to user action assert_true: Typed an invalid email, :user-invalid now matches expected true got false
 PASS :user-invalid selector properly interacts with submit & reset buttons
 PASS :user-error selector should not be supported
+FAIL required-input: A required input or textarea should match :user-invalid if a user types into it and then clears it before blurring. assert_true: Element should match :user-invalid after typing text and deleting it. expected true got false
+FAIL required-textarea: A required input or textarea should match :user-invalid if a user types into it and then clears it before blurring. assert_true: Element should match :user-invalid after typing text and deleting it. expected true got false

+++ /Volumes/Data/worker/Apple-iOS-17-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/css/selectors/valid-invalid-form-fieldset-actual.txt
@@ -1,4 +1,4 @@
 
 
-FAIL form and fieldset elements should match :valid/:invalid but not :user-valid/:user-invalid. assert_false: form should not match :invalid after valid text was entered. expected false got true
+FAIL form and fieldset elements should match :valid/:invalid but not :user-valid/:user-invalid. assert_true: form should match :invalid after invalid text was entered. expected true got false

[Radar WebKit Bug Importer]

<rdar://problem/119894365>

[EWS]

Test gardening commit 272301@main (23ee7d493e19): <https://commits.webkit.org/272301@main>

Reviewed commits have been landed. Closing PR #22063 and removing active labels.

[Robert Jenner]

I was able to reproduce all of these failures at iOS 17 ToT running the tests at follows:


run-webkit-tests --iOS-simulator <test_goes_here> 

It looks like:
imported/w3c/web-platform-tests/css/selectors/invalidation/user-valid-user-invalid.html 
imported/w3c/web-platform-tests/css/selectors/valid-invalid-form-fieldset.html

were newly added tests, whereas:
imported/w3c/web-platform-tests/css/selectors/user-invalid.html

was a re-import and started to fail at the same point as the other two.