Bug 206630 - REGRESSION [ iOS ] fast/forms/validationMessage.html is flaky and timing out
Summary: REGRESSION [ iOS ] fast/forms/validationMessage.html is flaky and timing out
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
Keywords: InRadar
Depends on:
Reported: 2020-01-22 16:52 PST by Jason Lawrence
Modified: 2020-05-08 13:43 PDT (History)
4 users (show)

See Also:

Update Test Expectations (1.38 KB, patch)
2020-01-27 14:02 PST, Jason Lawrence
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-01-22 16:52:49 PST

This test is flakey and timing out on iOS release.


--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-actual.txt
@@ -1,24 +1 @@
-Test for validationMessage DOM property.
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-input patternMismatch: Match the requested format
-input valueMissing: Fill out this field
-textarea valueMissing: Fill out this field
-select valueMissing: Select an item in the list
-input typeMismatch: Enter an email address
-input badInput: Enter a number
-badInput and valueMissing:
-PASS numberInput.validationMessage is nonRequiredBadInputMessage
-PASS but.validationMessage is ''
-PASS anoninput.validationMessage is ''
-PASS happyFieldset.validationMessage is ''
-PASS happySelect.validationMessage is ''
-PASS happyOutput.validationMessage is ''
-PASS happyObject.validationMessage is ''
-PASS happyKeygen.validationMessage is ''
-PASS successfullyParsed is true
+TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller
Comment 1 Radar WebKit Bug Importer 2020-01-22 16:53:32 PST
Comment 2 Alexey Proskuryakov 2020-01-22 23:02:05 PST
First timeout on January 17th. Also happens on iOS Debug.

> +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller

Simon added this in r254699, on January 16th.
Comment 3 Simon Fraser (smfr) 2020-01-23 13:32:13 PST
This is exactly the kind of problem that code was designed to detect.
Comment 4 Simon Fraser (smfr) 2020-01-23 13:32:44 PST
So now we're just causing fast/forms/validationMessage.html to time out, rather than making the next test flakey. Sounds like a progression to me.
Comment 5 Jason Lawrence 2020-01-27 14:02:33 PST
Created attachment 388904 [details]
Update Test Expectations
Comment 6 Truitt Savell 2020-01-27 14:05:07 PST
Comment on attachment 388904 [details]
Update Test Expectations

Clearing flags on attachment: 388904

Committed r255175: <https://trac.webkit.org/changeset/255175>
Comment 7 Jason Lawrence 2020-05-08 13:43:36 PDT
This test is no longer flaky timing out on Release, it is now flaky timing out on Debug. I have updated the expectations here: https://trac.webkit.org/changeset/261410/webkit

The first timeout for release was on 04/14/2020.