Bug 206630 – REGRESSION [ iOS ] fast/forms/validationMessage.html is flaky and timing out

• Status: NEW
• Component: Tools / Tests

[Jason Lawrence]

fast/forms/validationMessage.html

Description:
This test is flakey and timing out on iOS release.

History:
https://results.webkit.org/?suite=layout-tests&test=fast%2Fforms%2FvalidationMessage.html

Diff:
--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-actual.txt
@@ -1,24 +1 @@
-Test for validationMessage DOM property.
-
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-
-
-input patternMismatch: Match the requested format
-input valueMissing: Fill out this field
-textarea valueMissing: Fill out this field
-select valueMissing: Select an item in the list
-input typeMismatch: Enter an email address
-input badInput: Enter a number
-badInput and valueMissing:
-PASS numberInput.validationMessage is nonRequiredBadInputMessage
-PASS but.validationMessage is ''
-PASS anoninput.validationMessage is ''
-PASS happyFieldset.validationMessage is ''
-PASS happySelect.validationMessage is ''
-PASS happyOutput.validationMessage is ''
-PASS happyObject.validationMessage is ''
-PASS happyKeygen.validationMessage is ''
-PASS successfullyParsed is true
-
-TEST COMPLETE
-
+TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller

[Radar WebKit Bug Importer]

<rdar://problem/58817027>

[Alexey Proskuryakov]

First timeout on January 17th. Also happens on iOS Debug.

> +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller

Simon added this in r254699, on January 16th.

[Simon Fraser (smfr)]

This is exactly the kind of problem that code was designed to detect.

[Simon Fraser (smfr)]

So now we're just causing fast/forms/validationMessage.html to time out, rather than making the next test flakey. Sounds like a progression to me.

[Jason Lawrence]

Created attachment 388904 [details]
Update Test Expectations

[Truitt Savell]

Comment on attachment 388904 [details]
Update Test Expectations

Clearing flags on attachment: 388904

Committed r255175: <https://trac.webkit.org/changeset/255175>

[Jason Lawrence]

This test is no longer flaky timing out on Release, it is now flaky timing out on Debug. I have updated the expectations here: https://trac.webkit.org/changeset/261410/webkit

The first timeout for release was on 04/14/2020.