Bug 240538 – REGRESSION (r294316): [ iOS ] Eight imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation are a consistent failure

• Component: New Bugs
• Status: RESOLVED FIXED

[Karl Rackler]

Description:
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate.html

The first failure I saw on the dashboard was on 5/17/2022 at r294317 and looks to have introduced the consistent failure. 

History:
https://results.webkit.org/?platform=ios&limit=50000&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-checkValidity.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-badInput.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-rangeOverflow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-rangeUnderflow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-stepMismatch.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-valid.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-validity-valueMissing.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fforms%2Fconstraints%2Fform-validation-willValidate.html

Link to Diffs:
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-checkValidity-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeOverflow-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-rangeUnderflow-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-stepMismatch-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valid-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-valueMissing-diff.txt

imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate.html
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/250643%40main%20(1755)/imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-willValidate-diff.txt

[Radar WebKit Bug Importer]

<rdar://problem/93449475>

[Karl Rackler]

I have marked this test as a consistent failure while this issue is investigated.

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/690

[Ryan Haddad]

Are all the diffs showing PASS where we once showed FAIL? If so, sounds like a progression and we can rebaseline the tests.

[Karl Rackler]

Rebaseline tests

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/698

[EWS]

Test gardening commit r294354 (250661@main): <https://commits.webkit.org/250661@main>

Reviewed commits have been landed. Closing PR #698 and removing active labels.

[Tim Nguyen (:ntim)]

r294316 seems more likely

[Karl Rackler]

(In reply to Tim Nguyen (:ntim) from comment #8)
> r294316 seems more likely

I agree.

[Karl Rackler]

Rebaseline of tests complete.
Confirm all tests passing.