Bug 226789

Summary:	[iOS 14] imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html is a flaky failure
Product:	WebKit	Reporter:	Amir Mark Jr <amir_mark>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	ayumi_kojima, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Amir Mark Jr 2021-06-08 16:33:06 PDT

imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html

Is a flaky failure on iOS 14 WK2 Release for iPhone, iOS Wk2 Release for iPad, and iOS 14 Wk2 Debug.


History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebstorage%2Fevent_case_sensitive.html


Text Diff:

--- /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webstorage/event_case_sensitive-expected.txt
+++ /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webstorage/event_case_sensitive-actual.txt
@@ -1,4 +1,4 @@
 
 PASS sessionStorage storage events fire even when only the case of the value changes.
-PASS localStorage storage events fire even when only the case of the value changes.
+FAIL localStorage storage events fire even when only the case of the value changes. assert_unreached: got at least 1, expected only 0 events Reached unreachable code

Comment 1 Radar WebKit Bug Importer 2021-06-08 16:33:23 PDT

<rdar://problem/79042170>

Comment 2 ayumi_kojima 2021-07-23 14:05:50 PDT

I was not able to reproduce the failure on the simulator (iOS15) on my local machine using: 

run-webkit-tests --ios-simulator --iterations 50 --exit-after-n-failures 2 --exit-after-n-crashes-or-timeouts 2 imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html 

The test timed out. It hanged with --no-timeout flag.

Looks like the test has been flaky for long time. The oldest revision that marked as failure is r277144. It seems the test was introduced at r277004.

Comment 3 ayumi_kojima 2021-07-23 15:40:32 PDT

Updated test expectations https://trac.webkit.org/changeset/280263/webkit

Comment 4 ayumi_kojima 2021-08-23 13:44:30 PDT

The test is flaky on macOS-Catalina-Release-WK2-Tests-EWS.

Comment 5 ayumi_kojima 2021-08-23 14:07:25 PDT

Updated test expectations for Catalina so that it won't show up on EWS. https://trac.webkit.org/changeset/281469/webkit