Bug 212281 - REGRESSION: (r261812?): [ iOS wk2 Release ] editing/async-clipboard/clipboard-item-get-type-basic.html is flaky failing
Summary: REGRESSION: (r261812?): [ iOS wk2 Release ] editing/async-clipboard/clipboard...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: HTML Editing (show other bugs)
Version: WebKit Nightly Build
Hardware: iPhone / iPad iOS 13
: P2 Normal
Assignee: Wenson Hsieh
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-05-22 14:48 PDT by Jason Lawrence
Modified: 2020-05-25 14:38 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-05-22 14:48:06 PDT
editing/async-clipboard/clipboard-item-get-type-basic.html

Description:
This test is flaky failing on iOS wk2 release. It was passing consistently until 5/19/2020. 

History:
https://results.webkit.org/?suite=layout-tests&test=editing%2Fasync-clipboard%2Fclipboard-item-get-type-basic.html&platform=ios&limit=50000&style=release

Diff:
--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/editing/async-clipboard/clipboard-item-get-type-basic-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/editing/async-clipboard/clipboard-item-get-type-basic-actual.txt
@@ -2,12 +2,9 @@
 
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
-PASS items.length is 1
-PASS item.types.length is 3
-PASS text is "Apple, Inc."
-PASS url is "https://www.apple.com/"
-PASS doc.querySelector('a').href is "https://www.apple.com/"
+FAIL Caught unexpected exception: NotAllowedError
 PASS successfullyParsed is true
+Some tests failed.
 
 TEST COMPLETE
Comment 1 Radar WebKit Bug Importer 2020-05-22 14:48:35 PDT
<rdar://problem/63554912>
Comment 2 Jason Lawrence 2020-05-22 14:57:34 PDT
I have marked this test as flaky failing while this issue is investigated.
https://trac.webkit.org/changeset/262078/webkit
Comment 3 Jason Lawrence 2020-05-22 15:55:16 PDT
I am able to reproduce this issue on 261815 using the command below, but I cannot reproduce it on 261811.

run-webkit-tests --ios-simulator --device-type iPhone SE --iterations 99 --exit-after-n-failures 3 --force editing/async-clipboard/clipboard-item-get-type-basic.html

r261815:
[27/99] editing/async-clipboard/clipboard-item-get-type-basic.html failed unexpectedly (text diff)
[41/99] editing/async-clipboard/clipboard-item-get-type-basic.html failed unexpectedly (text diff)
[47/99] editing/async-clipboard/clipboard-item-get-type-basic.html failed unexpectedly (text diff)
Exiting early after 3 failures. 47 tests run.


44 tests ran as expected, 3 didn't (52 didn't run):

r261811:
All 99 tests ran as expected.
Comment 4 Alexey Proskuryakov 2020-05-25 14:37:42 PDT
r261812 is the only editing change in this range, and a very timing sensitive one.