Bug 196228 - [ Mac WK2 iOS Simulator ] REGRESSION (r243339) Layout Test http/tests/cache-storage/cache-records-persistency.https.html is a flaky failure
Summary: [ Mac WK2 iOS Simulator ] REGRESSION (r243339) Layout Test http/tests/cache-s...
Status: RESOLVED DUPLICATE of bug 196467
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-03-25 16:45 PDT by Shawn Roberts
Modified: 2019-04-10 15:47 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Shawn Roberts 2019-03-25 16:45:52 PDT
The following layout tests are failing on Mac iOS Simulator WK2

http/tests/cache-storage/cache-clearing-origin.https.html
http/tests/cache-storage/cache-records-persistency.https.html


Probable cause:

Tests have been flaky for awhile now, but changes in r243339 have caused it to become almost a 75% failure rate. Tests run prior to this revision fail approximately once in 1000 runs, with this revision they get 10 errors in 26 runs. 

Reproduced with : 

run-webkit-tests http/tests/cache-storage/cache-records-persistency.https.html http/tests/cache-storage/cache-clearing-origin.https.html --iterations 100 --child-process 1 --ios-simulator --exit-after-n-failures=10 --no-retry

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html?tests=http%2Ftests%2Fcache-storage%2Fcache-records-persistency.https.html+performance-api%2Fperformance-observer-periodic.html+scrollingcoordinator%2Fios%2Fui-scroll-fixed.html+storage%2Findexeddb%2Fmodern%2Fidbtransaction-objectstore-failures-private.html#showAllRuns=true&tests=http%2Ftests%2Fcache-storage%2Fcache-records-persistency.https.html%20http%2Ftests%2Fcache-storage%2Fcache-clearing-origin.https.html

Diff :

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-actual.txt
@@ -1,9 +1,7 @@
 
 PASS Cleaning existing caches 
-PASS Cache.put called twice with matching Requests - keys should remain the same - testing persistency 
+FAIL Cache.put called twice with matching Requests - keys should remain the same - testing persistency promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'result.text')"
 PASS Cleaning created caches 
-PASS Checking persistency of cache keys 
-PASS Checking persistency of response 
-PASS Checking persistency of response body 
-PASS Testing overriding of an existing cached record that is not in memory 
+FAIL Checking persistency of cache keys assert_equals: expected 1 but got 0
+FAIL Checking persistency of response assert_equals: Cache.put should store the response persistently expected "[object Response]" but got "[object Undefined]"

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-actual.txt
@@ -1,9 +1,7 @@
 
 PASS Cleaning existing caches 
-PASS Cache.put called twice with matching Requests - keys should remain the same - testing persistency 
+FAIL Cache.put called twice with matching Requests - keys should remain the same - testing persistency promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'result.text')"
 PASS Cleaning created caches 
-PASS Checking persistency of cache keys 
-PASS Checking persistency of response 
-PASS Checking persistency of response body 
-PASS Testing overriding of an existing cached record that is not in memory 
+FAIL Checking persistency of cache keys assert_equals: expected 1 but got 0
+FAIL Checking persistency of response assert_equals: Cache.put should store the response persistently expected "[object Response]" but got "[object Undefined]"
Comment 1 Radar WebKit Bug Importer 2019-03-25 16:47:22 PDT
<rdar://problem/49236210>
Comment 2 Shawn Roberts 2019-03-25 16:58:56 PDT
Marked as flaky in https://trac.webkit.org/changeset/243473/webkit While waiting for a fix.
Comment 3 youenn fablet 2019-04-10 15:47:16 PDT

*** This bug has been marked as a duplicate of bug 196467 ***