223291 2021-03-16 17:25:08 -0700 [ macOS wk2 ARM 64 ] 2 accessibility/mac/value-change/ layout-tests are flakey text failures 2021-03-17 11:16:52 -0700 1 1 1 Unclassified WebKit Accessibility WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 jenner webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1740318 0 jenner 2021-03-16 17:25:08 -0700 accessibility/mac/value-change/value-change-user-info-textfield.html accessibility/mac/value-change/value-change-user-info-textarea.html are flakey text failures on macOS BigSur wk2 on Apple Silicon only. Both tests are flakey text failing on release, but "accessibility/mac/value-change/value-change-user-info-textarea.html" has text failed once or twice on debug. HISTORY URL: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=accessibility%2Fmac%2Fvalue-change%2Fvalue-change-user-info-textarea.html&test=accessibility%2Fmac%2Fvalue-change%2Fvalue-change-user-info-textfield.html&platform=mac&architecture=arm64 TEXT DIFF for "accessibility/mac/value-change/value-change-user-info-textfield.html": PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] PASS actualEditTypes[resultIndex][1] is "Typing" PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit -PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0] +FAIL actualChangeValues[resultIndex][0] should be 9. Was 8. PASS actualEditTypes[resultIndex][0] is "Delete" -PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] +FAIL actualChangeValues[resultIndex][1] should be 8. Was 9. PASS actualEditTypes[resultIndex][1] is "Insert" PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit -PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0] +FAIL actualChangeValues[resultIndex][0] should be 8. Was 9. PASS actualEditTypes[resultIndex][0] is "Delete" PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] PASS actualEditTypes[resultIndex][1] is "Insert" PASS successfullyParsed is true +Some tests failed. TEXT DIFF for "accessibility/mac/value-change/value-change-user-info-textarea.html": PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] PASS actualEditTypes[resultIndex][1] is "Typing" PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit -PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0] +FAIL actualChangeValues[resultIndex][0] should be 6. Was 5. PASS actualEditTypes[resultIndex][0] is "Delete" -PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] +FAIL actualChangeValues[resultIndex][1] should be 5. Was 6. PASS actualEditTypes[resultIndex][1] is "Insert" PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit -PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0] +FAIL actualChangeValues[resultIndex][0] should be 5. Was 6. PASS actualEditTypes[resultIndex][0] is "Delete" PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1] PASS actualEditTypes[resultIndex][1] is "Insert" PASS successfullyParsed is true +Some tests failed. 1740320 1 webkit-bug-importer 2021-03-16 17:30:47 -0700 <rdar://problem/75503005> 1740323 2 jenner 2021-03-16 17:38:18 -0700 Updated test expectations here to Pass Failure while test is reviewed: https://trac.webkit.org/changeset/274540/webkit 1740324 3 jenner 2021-03-16 17:38:53 -0700 The failures appear to only occur on Apple Silicon Macs, and as such I cannot reproduce the failures because I do not have access to one. 1740798 4 ap 2021-03-17 11:16:52 -0700 This seems unlikely to a be a truly Apple Silicon specific issue.