Bug 227891

Summary: [ iOS BigSur ] http/tests/appcache/fail-on-update.html is a flaky timeout
Product: WebKit Reporter: ayumi_kojima
Component: New BugsAssignee: ayumi_kojima
Status: NEW ---    
Severity: Normal CC: jbedard, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: iPhone / iPad   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=57043
Attachments:
Description Flags
Patch
none
Patch
none
Patch
none
Update TestExpectations none

Description ayumi_kojima 2021-07-12 17:12:46 PDT
http/tests/appcache/fail-on-update.html

Is a flaky timeout on iOS 14 E Simulator wk2 on iPad (Release) and iPhone SE (Release & Debug).

History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fappcache%2Ffail-on-update.html
Comment 1 Radar WebKit Bug Importer 2021-07-12 17:14:09 PDT
<rdar://problem/80490439>
Comment 2 ayumi_kojima 2021-07-13 08:56:36 PDT
Created attachment 433408 [details]
Patch
Comment 3 ayumi_kojima 2021-07-13 10:07:27 PDT
Created attachment 433415 [details]
Patch
Comment 4 ayumi_kojima 2021-07-13 11:12:15 PDT
Created attachment 433424 [details]
Patch
Comment 5 ayumi_kojima 2021-07-13 11:18:31 PDT
Created attachment 433428 [details]
Update TestExpectations
Comment 6 Ryan Haddad 2021-07-13 12:20:56 PDT
Comment on attachment 433428 [details]
Update TestExpectations

Clearing flags on attachment: 433428

Committed r279882 (239634@main): <https://commits.webkit.org/239634@main>
Comment 7 ayumi_kojima 2021-07-20 17:29:39 PDT
After the expectation was marked as [Pass Timeout] previously, a flaky failure started showing up in the result dashboard.

Noticed that there is a test expectation set as [ DumpJSConsoleLogInStdErr ] in LayoutTests/TestExpectations. 

Will update the test expectations in ios-wk2 to [ DumpJSConsoleLogInStdErr Slow ] to stop the failures. This will also determine if the timeouts are actual timeouts, or a test just being slow.
Comment 8 ayumi_kojima 2021-07-20 17:39:05 PDT
Updated test expectations here: https://trac.webkit.org/changeset/280118/webkit
Comment 9 ayumi_kojima 2021-09-29 09:03:44 PDT
The test is still flaky on both iOS 14 & 15. Updated test expectations: https://trac.webkit.org/changeset/283222/webkit
Comment 10 ayumi_kojima 2021-09-29 09:11:53 PDT
The test is flaky on BigSur wk1 Release and wk2 Debug now. Updated expectations: https://trac.webkit.org/changeset/283224/webkit