fast/forms/validationMessage.html Description: This test is flakey and timing out on iOS release. History: https://results.webkit.org/?suite=layout-tests&test=fast%2Fforms%2FvalidationMessage.html Diff: --- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-expected.txt +++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-actual.txt @@ -1,24 +1 @@ -Test for validationMessage DOM property. - -On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". - - -input patternMismatch: Match the requested format -input valueMissing: Fill out this field -textarea valueMissing: Fill out this field -select valueMissing: Select an item in the list -input typeMismatch: Enter an email address -input badInput: Enter a number -badInput and valueMissing: -PASS numberInput.validationMessage is nonRequiredBadInputMessage -PASS but.validationMessage is '' -PASS anoninput.validationMessage is '' -PASS happyFieldset.validationMessage is '' -PASS happySelect.validationMessage is '' -PASS happyOutput.validationMessage is '' -PASS happyObject.validationMessage is '' -PASS happyKeygen.validationMessage is '' -PASS successfullyParsed is true - -TEST COMPLETE - +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller
<rdar://problem/58817027>
First timeout on January 17th. Also happens on iOS Debug. > +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller Simon added this in r254699, on January 16th.
This is exactly the kind of problem that code was designed to detect.
So now we're just causing fast/forms/validationMessage.html to time out, rather than making the next test flakey. Sounds like a progression to me.
Created attachment 388904 [details] Update Test Expectations
Comment on attachment 388904 [details] Update Test Expectations Clearing flags on attachment: 388904 Committed r255175: <https://trac.webkit.org/changeset/255175>
This test is no longer flaky timing out on Release, it is now flaky timing out on Debug. I have updated the expectations here: https://trac.webkit.org/changeset/261410/webkit The first timeout for release was on 04/14/2020.