240538 2022-05-17 13:41:27 -0700 REGRESSION (r294316): [ iOS ] Eight imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation are a consistent failure 2022-05-18 08:16:18 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 rackler rackler ntim webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1869789 0 rackler 2022-05-17 13:41:27 -0700 Description: imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing.html imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate.html The first failure I saw on the dashboard was on 5/17/2022 at r294317 and looks to have introduced the consistent failure. History: https://results.webkit.org/?platform=ios&limit=50000&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-checkValidity.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-badInput.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-rangeOverflow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-rangeUnderflow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-stepMismatch.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-valid.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-valueMissing.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-willValidate.html Link to Diffs: imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing-diff.txt imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate.html https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate-diff.txt 1869790 1 webkit-bug-importer 2022-05-17 13:41:43 -0700 <rdar://problem/93449475> 1869792 2 rackler 2022-05-17 13:54:24 -0700 I have marked this test as a consistent failure while this issue is investigated. 1869794 3 rackler 2022-05-17 13:58:14 -0700 Pull request: https://github.com/WebKit/WebKit/pull/690 1869795 4 ryanhaddad 2022-05-17 14:00:06 -0700 Are all the diffs showing PASS where we once showed FAIL? If so, sounds like a progression and we can rebaseline the tests. 1869817 5 rackler 2022-05-17 15:09:15 -0700 Rebaseline tests 1869825 6 rackler 2022-05-17 15:16:00 -0700 Pull request: https://github.com/WebKit/WebKit/pull/698 1869829 7 ews-feeder 2022-05-17 15:32:10 -0700 Test gardening commit r294354 (250661@main): <https://commits.webkit.org/250661@main> Reviewed commits have been landed. Closing PR #698 and removing active labels. 1869918 8 ntim 2022-05-17 21:56:14 -0700 r294316 seems more likely 1870006 9 rackler 2022-05-18 08:15:40 -0700 (In reply to Tim Nguyen (:ntim) from comment #8) > r294316 seems more likely I agree. 1870007 10 rackler 2022-05-18 08:16:18 -0700 Rebaseline of tests complete. Confirm all tests passing.