Bug 226789 - [iOS 14] imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html is a flaky failure
Summary: [iOS 14] imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-06-08 16:33 PDT by Amir Mark Jr
Modified: 2021-08-23 14:07 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Amir Mark Jr 2021-06-08 16:33:06 PDT
imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html

Is a flaky failure on iOS 14 WK2 Release for iPhone, iOS Wk2 Release for iPad, and iOS 14 Wk2 Debug.


History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebstorage%2Fevent_case_sensitive.html


Text Diff:

--- /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webstorage/event_case_sensitive-expected.txt
+++ /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webstorage/event_case_sensitive-actual.txt
@@ -1,4 +1,4 @@
 
 PASS sessionStorage storage events fire even when only the case of the value changes.
-PASS localStorage storage events fire even when only the case of the value changes.
+FAIL localStorage storage events fire even when only the case of the value changes. assert_unreached: got at least 1, expected only 0 events Reached unreachable code
Comment 1 Radar WebKit Bug Importer 2021-06-08 16:33:23 PDT
<rdar://problem/79042170>
Comment 2 ayumi_kojima 2021-07-23 14:05:50 PDT
I was not able to reproduce the failure on the simulator (iOS15) on my local machine using: 

run-webkit-tests --ios-simulator --iterations 50 --exit-after-n-failures 2 --exit-after-n-crashes-or-timeouts 2 imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html 

The test timed out. It hanged with --no-timeout flag.

Looks like the test has been flaky for long time. The oldest revision that marked as failure is r277144. It seems the test was introduced at r277004.
Comment 3 ayumi_kojima 2021-07-23 15:40:32 PDT
Updated test expectations https://trac.webkit.org/changeset/280263/webkit
Comment 4 ayumi_kojima 2021-08-23 13:44:30 PDT
The test is flaky on macOS-Catalina-Release-WK2-Tests-EWS.
Comment 5 ayumi_kojima 2021-08-23 14:07:25 PDT
Updated test expectations for Catalina so that it won't show up on EWS. https://trac.webkit.org/changeset/281469/webkit