Bug 230066 - [ BigSur wk2 Debug ] accessibility/mac/native-text-control-set-selected-textmarker-range.html is a flaky failure
Summary: [ BigSur wk2 Debug ] accessibility/mac/native-text-control-set-selected-textm...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Accessibility (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac (Intel) Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-09-08 14:35 PDT by ayumi_kojima
Modified: 2021-09-13 13:59 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-09-08 14:35:29 PDT
accessibility/mac/native-text-control-set-selected-textmarker-range.html

Is a flaky failure on BigSur wk2 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fnative-text-control-set-selected-textmarker-range.html

Result Page: https://build.webkit.org/results/Apple-BigSur-Debug-WK2-Tests/r282147%20(3647)/results.html

Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/storage/persisted.https.any-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/storage/persisted.https.any-actual.txt
@@ -1,4 +1,4 @@
 
 PASS persisted() method exists and returns a Promise
-PASS persisted() returns a promise and resolves as boolean with false
+FAIL persisted() returns a promise and resolves as boolean with false assert_equals: expected false but got true
Comment 1 Radar WebKit Bug Importer 2021-09-08 14:35:47 PDT
<rdar://problem/82892230>
Comment 2 ayumi_kojima 2021-09-08 14:45:43 PDT
Marked expectations https://trac.webkit.org/changeset/282173/webkit
Comment 3 Alexey Proskuryakov 2021-09-12 13:58:40 PDT
The diff above is for a different test. The correct one is:

--- /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/accessibility/mac/native-text-control-set-selected-textmarker-range-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/accessibility/mac/native-text-control-set-selected-textmarker-range-actual.txt
@@ -8,7 +8,7 @@
 selected text " is a "
 selected text "This is a text field."
 selected text "This is a "
-selected text " is a text"
+selected text "This is a "
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 4 ayumi_kojima 2021-09-13 12:02:35 PDT
I was able to reproduce the failure at TOT using run-webkit-tests --iterations 100 --exit-after-n-failures 1 --force accessibility/mac/native-text-control-set-selected-textmarker-range.html --debug -f
Comment 5 ayumi_kojima 2021-09-13 13:58:59 PDT
It seems that the test is flaky failing since it was added at https://trac.webkit.org/changeset/281691/webkit. I was able to reproduce the failure at r281695 but not at r281691 because a testable revision was not available.