Bug 196358 - [ Mojave WK2 iOS Sim ] Layout Test http/wpt/cache-storage/quota-third-party.https.html is a flaky failure
Summary: [ Mojave WK2 iOS Sim ] Layout Test http/wpt/cache-storage/quota-third-party.h...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-03-28 11:33 PDT by Shawn Roberts
Modified: 2019-04-10 16:18 PDT (History)
6 users (show)

See Also:


Attachments
Patch (1.62 KB, patch)
2019-04-10 15:54 PDT, youenn fablet
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Shawn Roberts 2019-03-28 11:33:39 PDT
The following layout test is failing on Mojave WK2 and Debug. iOS Simulator Release and Debug

http/wpt/cache-storage/quota-third-party.https.html

Probable cause:

Test was added in https://trac.webkit.org/changeset/243247/webkit and started showing up on the dashboard shortly after that.

Is reproducible locally but will pass the first time, and fail subsequent iterations and pass on the retry. This happens even if I run 1 child process. Is far more flaky on iOS Simulator Release queue compared to other queues.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fcache-storage%2Fquota-third-party.https.html

Diff: 

--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/wpt/cache-storage/quota-third-party.https-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/wpt/cache-storage/quota-third-party.https-actual.txt
@@ -1,6 +1,6 @@
-CONSOLE MESSAGE: Cache API operation failed: Quota exceeded
+CONSOLE MESSAGE: Cache API operation failed: Failed writing data to the file system
   
 
-PASS same origin iframe has regular quota 
-PASS cross origin iframe has reduced quota 
+FAIL same origin iframe has regular quota assert_equals: expected "PASS" but got "UNEXPECTED"
+FAIL cross origin iframe has reduced quota assert_equals: expected "FAIL" but got "PASS"
Comment 1 Radar WebKit Bug Importer 2019-03-28 11:34:07 PDT
<rdar://problem/49388128>
Comment 2 Shawn Roberts 2019-03-28 11:39:53 PDT
Marked flaky in https://trac.webkit.org/changeset/243613/webkit while waiting for a fix.
Comment 3 youenn fablet 2019-04-10 15:50:37 PDT
iOS sim test fails as timing out. It often passes after a long run like 20 seconds.
Will mark it as Slow.
Comment 4 youenn fablet 2019-04-10 15:54:44 PDT
Created attachment 367173 [details]
Patch
Comment 5 WebKit Commit Bot 2019-04-10 16:18:35 PDT
Comment on attachment 367173 [details]
Patch

Clearing flags on attachment: 367173

Committed r244168: <https://trac.webkit.org/changeset/244168>
Comment 6 WebKit Commit Bot 2019-04-10 16:18:36 PDT
All reviewed patches have been landed.  Closing bug.