206630 2020-01-22 16:52:49 -0800 REGRESSION [ iOS ] fast/forms/validationMessage.html is flaky and timing out 2020-05-08 13:43:36 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 Lawrence.j webkit-unassigned simon.fraser tsavell webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1609857 0 Lawrence.j 2020-01-22 16:52:49 -0800 fast/forms/validationMessage.html Description: This test is flakey and timing out on iOS release. History: https://results.webkit.org/?suite=layout-tests&test=fast%2Fforms%2FvalidationMessage.html Diff: --- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-expected.txt +++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/fast/forms/validationMessage-actual.txt @@ -1,24 +1 @@ -Test for validationMessage DOM property. - -On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". - - -input patternMismatch: Match the requested format -input valueMissing: Fill out this field -textarea valueMissing: Fill out this field -select valueMissing: Select an item in the list -input typeMismatch: Enter an email address -input badInput: Enter a number -badInput and valueMissing: -PASS numberInput.validationMessage is nonRequiredBadInputMessage -PASS but.validationMessage is '' -PASS anoninput.validationMessage is '' -PASS happyFieldset.validationMessage is '' -PASS happySelect.validationMessage is '' -PASS happyOutput.validationMessage is '' -PASS happyObject.validationMessage is '' -PASS happyKeygen.validationMessage is '' -PASS successfullyParsed is true - -TEST COMPLETE - +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller 1609859 1 webkit-bug-importer 2020-01-22 16:53:32 -0800 <rdar://problem/58817027> 1609982 2 ap 2020-01-22 23:02:05 -0800 First timeout on January 17th. Also happens on iOS Debug. > +TestController::platformResetPreferencesToConsistentValues - Failed to remove presented view controller Simon added this in r254699, on January 16th. 1610293 3 simon.fraser 2020-01-23 13:32:13 -0800 This is exactly the kind of problem that code was designed to detect. 1610294 4 simon.fraser 2020-01-23 13:32:44 -0800 So now we're just causing fast/forms/validationMessage.html to time out, rather than making the next test flakey. Sounds like a progression to me. 1611597 5 388904 Lawrence.j 2020-01-27 14:02:33 -0800 Created attachment 388904 Update Test Expectations 1611601 6 388904 tsavell 2020-01-27 14:05:07 -0800 Comment on attachment 388904 Update Test Expectations Clearing flags on attachment: 388904 Committed r255175: <https://trac.webkit.org/changeset/255175> 1650744 7 Lawrence.j 2020-05-08 13:43:36 -0700 This test is no longer flaky timing out on Release, it is now flaky timing out on Debug. I have updated the expectations here: https://trac.webkit.org/changeset/261410/webkit The first timeout for release was on 04/14/2020. 388904 2020-01-27 14:02:33 -0800 2020-01-27 17:08:41 -0800 Update Test Expectations bug-206630-20200127140232.patch text/plain 1410 Lawrence.j U3VidmVyc2lvbiBSZXZpc2lvbjogMjU1MTc0CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggNWQ0MmI4NWQxMjg5YzAzYTA1OGJh NDIwMjAyNWYwZDlkZjM1ZmFkZi4uZTNiMTNhMDk3YWU4ZmQzMmJhYWRlYTE2MmM5ZjIxM2Y2ODVh ZGU0YSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEyIEBACisyMDIwLTAxLTI3ICBKYXNvbiBMYXdyZW5jZSAg PGxhd3JlbmNlLmpAYXBwbGUuY29tPgorCisgICAgICAgIFJFR1JFU1NJT04gKHIyNTQ2OTkpOiBb IGlPUyBdIGZhc3QvZm9ybXMvdmFsaWRhdGlvbk1lc3NhZ2UuaHRtbCBpcyBmbGFreSBhbmQgdGlt aW5nIG91dAorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9 MjA2NjMwCisKKyAgICAgICAgVW5yZXZpZXdlZCB0ZXN0IGdhcmRlbmluZworCisgICAgICAgICog cGxhdGZvcm0vaW9zLXdrMi9UZXN0RXhwZWN0YXRpb25zOgorCiAyMDIwLTAxLTI3ICBKYWNvYiBV cGhvZmYgIDxqYWNvYl91cGhvZmZAYXBwbGUuY29tPgogCiAgICAgICAgIFsgbWFjT1MgV0sxIF0g ZmFzdC9mb3Jtcy90ZXh0YXJlYS90ZXh0YXJlYS1zdGF0ZS1yZXN0b3JlLmh0bWwgaXMgZmxha3kg ZmFpbGluZwpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vaW9zLXdrMi9UZXN0RXhw ZWN0YXRpb25zIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0vaW9zLXdrMi9UZXN0RXhwZWN0YXRpb25z CmluZGV4IGFmMTRhNDYyNzkyNTc2Y2M1NzY4ODk2NmE2MjQwNTllY2Q0NzlmZDIuLmYxZDAxNDRj ZjdjZjRjZGRmNTBiYmI1YjliMjFkMGRlNWRlYzY0M2YgMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3Rz L3BsYXRmb3JtL2lvcy13azIvVGVzdEV4cGVjdGF0aW9ucworKysgYi9MYXlvdXRUZXN0cy9wbGF0 Zm9ybS9pb3Mtd2syL1Rlc3RFeHBlY3RhdGlvbnMKQEAgLTEzNDksMyArMTM0OSw1IEBAIHdlYmtp dC5vcmcvYi8yMDM2MzcgZmFzdC9jc3MtY3VzdG9tLXBhaW50L3NpbXBsZS1oaWRwaS5odG1sIFsg UGFzcyBJbWFnZU9ubHlGYWlsCiB3ZWJraXQub3JnL2IvMjA1MzA4IGFjY2Vzc2liaWxpdHkvc21h cnQtaW52ZXJ0LXJlZmVyZW5jZS5odG1sIFsgSW1hZ2VPbmx5RmFpbHVyZSBdCiAKIHdlYmtpdC5v cmcvYi8yMDY2MTYgWyBSZWxlYXNlIF0gaHR0cC90ZXN0cy9zZWN1cml0eS9jb250ZW50U2VjdXJp dHlQb2xpY3kvbW9kdWxlLWV2YWwtYmxvY2tlZC1pbi1leHRlcm5hbC1zY3JpcHQuaHRtbCBbIFBh c3MgVGltZW91dCBdCisKK3dlYmtpdC5vcmcvYi8yMDY2MzAgWyBSZWxlYXNlIF0gZmFzdC9mb3Jt cy92YWxpZGF0aW9uTWVzc2FnZS5odG1sIFsgUGFzcyBUaW1lb3V0IF0K