Bug 223291 – [ macOS wk2 ARM 64 ] 2 accessibility/mac/value-change/ layout-tests are flakey text failures

• Status: NEW
• Component: Accessibility

[Robert Jenner]

accessibility/mac/value-change/value-change-user-info-textfield.html
accessibility/mac/value-change/value-change-user-info-textarea.html

are flakey text failures on macOS BigSur wk2 on Apple Silicon only. 

Both tests are flakey text failing on release, but "accessibility/mac/value-change/value-change-user-info-textarea.html" has text failed once or twice on debug. 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=accessibility%2Fmac%2Fvalue-change%2Fvalue-change-user-info-textarea.html&test=accessibility%2Fmac%2Fvalue-change%2Fvalue-change-user-info-textfield.html&platform=mac&architecture=arm64

TEXT DIFF for "accessibility/mac/value-change/value-change-user-info-textfield.html":
 PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
 PASS actualEditTypes[resultIndex][1] is "Typing"
 PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit
-PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0]
+FAIL actualChangeValues[resultIndex][0] should be 9. Was 8.
 PASS actualEditTypes[resultIndex][0] is "Delete"
-PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
+FAIL actualChangeValues[resultIndex][1] should be 8. Was 9.
 PASS actualEditTypes[resultIndex][1] is "Insert"
 PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit
-PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0]
+FAIL actualChangeValues[resultIndex][0] should be 8. Was 9.
 PASS actualEditTypes[resultIndex][0] is "Delete"
 PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
 PASS actualEditTypes[resultIndex][1] is "Insert"
 PASS successfullyParsed is true
+Some tests failed.

TEXT DIFF for "accessibility/mac/value-change/value-change-user-info-textarea.html":
 PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
 PASS actualEditTypes[resultIndex][1] is "Typing"
 PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit
-PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0]
+FAIL actualChangeValues[resultIndex][0] should be 6. Was 5.
 PASS actualEditTypes[resultIndex][0] is "Delete"
-PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
+FAIL actualChangeValues[resultIndex][1] should be 5. Was 6.
 PASS actualEditTypes[resultIndex][1] is "Insert"
 PASS actualChangeTypes[resultIndex] is AXTextStateChangeTypeEdit
-PASS actualChangeValues[resultIndex][0] is expectedValues[resultIndex][0]
+FAIL actualChangeValues[resultIndex][0] should be 5. Was 6.
 PASS actualEditTypes[resultIndex][0] is "Delete"
 PASS actualChangeValues[resultIndex][1] is expectedValues[resultIndex][1]
 PASS actualEditTypes[resultIndex][1] is "Insert"
 PASS successfullyParsed is true
+Some tests failed.

[Radar WebKit Bug Importer]

<rdar://problem/75503005>

[Robert Jenner]

Updated test expectations here to Pass Failure while test is reviewed:

https://trac.webkit.org/changeset/274540/webkit

[Robert Jenner]

The failures appear to only occur on Apple Silicon Macs, and as such I cannot reproduce the failures because I do not have access to one.

[Alexey Proskuryakov]

This seems unlikely to a be a truly Apple Silicon specific issue.