Bug 230066

Summary:	[ BigSur wk2 Debug ] accessibility/mac/native-text-control-set-selected-textmarker-range.html is a flaky failure
Product:	WebKit	Reporter:	ayumi_kojima
Component:	Accessibility	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	andresg_22, cfleizach, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac (Intel)
OS:	Unspecified

Description ayumi_kojima 2021-09-08 14:35:29 PDT

accessibility/mac/native-text-control-set-selected-textmarker-range.html

Is a flaky failure on BigSur wk2 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fnative-text-control-set-selected-textmarker-range.html

Result Page: https://build.webkit.org/results/Apple-BigSur-Debug-WK2-Tests/r282147%20(3647)/results.html

Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/storage/persisted.https.any-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/storage/persisted.https.any-actual.txt
@@ -1,4 +1,4 @@
 
 PASS persisted() method exists and returns a Promise
-PASS persisted() returns a promise and resolves as boolean with false
+FAIL persisted() returns a promise and resolves as boolean with false assert_equals: expected false but got true

Comment 1 Radar WebKit Bug Importer 2021-09-08 14:35:47 PDT

<rdar://problem/82892230>

Comment 2 ayumi_kojima 2021-09-08 14:45:43 PDT

Marked expectations https://trac.webkit.org/changeset/282173/webkit

Comment 3 Alexey Proskuryakov 2021-09-12 13:58:40 PDT

The diff above is for a different test. The correct one is:

--- /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/accessibility/mac/native-text-control-set-selected-textmarker-range-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/accessibility/mac/native-text-control-set-selected-textmarker-range-actual.txt
@@ -8,7 +8,7 @@
 selected text " is a "
 selected text "This is a text field."
 selected text "This is a "
-selected text " is a text"
+selected text "This is a "
 PASS successfullyParsed is true
 
 TEST COMPLETE

Comment 4 ayumi_kojima 2021-09-13 12:02:35 PDT

I was able to reproduce the failure at TOT using run-webkit-tests --iterations 100 --exit-after-n-failures 1 --force accessibility/mac/native-text-control-set-selected-textmarker-range.html --debug -f

Comment 5 ayumi_kojima 2021-09-13 13:58:59 PDT

It seems that the test is flaky failing since it was added at https://trac.webkit.org/changeset/281691/webkit. I was able to reproduce the failure at r281695 but not at r281691 because a testable revision was not available.