Bug 196228 – [ Mac WK2 iOS Simulator ] REGRESSION (r243339) Layout Test http/tests/cache-storage/cache-records-persistency.https.html is a flaky failure

• Component: Tools / Tests
• Status: RESOLVED DUPLICATE

[Shawn Roberts]

The following layout tests are failing on Mac iOS Simulator WK2

http/tests/cache-storage/cache-clearing-origin.https.html
http/tests/cache-storage/cache-records-persistency.https.html


Probable cause:

Tests have been flaky for awhile now, but changes in r243339 have caused it to become almost a 75% failure rate. Tests run prior to this revision fail approximately once in 1000 runs, with this revision they get 10 errors in 26 runs. 

Reproduced with : 

run-webkit-tests http/tests/cache-storage/cache-records-persistency.https.html http/tests/cache-storage/cache-clearing-origin.https.html --iterations 100 --child-process 1 --ios-simulator --exit-after-n-failures=10 --no-retry

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html?tests=http%2Ftests%2Fcache-storage%2Fcache-records-persistency.https.html+performance-api%2Fperformance-observer-periodic.html+scrollingcoordinator%2Fios%2Fui-scroll-fixed.html+storage%2Findexeddb%2Fmodern%2Fidbtransaction-objectstore-failures-private.html#showAllRuns=true&tests=http%2Ftests%2Fcache-storage%2Fcache-records-persistency.https.html%20http%2Ftests%2Fcache-storage%2Fcache-clearing-origin.https.html

Diff :

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-actual.txt
@@ -1,9 +1,7 @@
 
 PASS Cleaning existing caches 
-PASS Cache.put called twice with matching Requests - keys should remain the same - testing persistency 
+FAIL Cache.put called twice with matching Requests - keys should remain the same - testing persistency promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'result.text')"
 PASS Cleaning created caches 
-PASS Checking persistency of cache keys 
-PASS Checking persistency of response 
-PASS Checking persistency of response body 
-PASS Testing overriding of an existing cached record that is not in memory 
+FAIL Checking persistency of cache keys assert_equals: expected 1 but got 0
+FAIL Checking persistency of response assert_equals: Cache.put should store the response persistently expected "[object Response]" but got "[object Undefined]"

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache-storage/cache-records-persistency.https-actual.txt
@@ -1,9 +1,7 @@
 
 PASS Cleaning existing caches 
-PASS Cache.put called twice with matching Requests - keys should remain the same - testing persistency 
+FAIL Cache.put called twice with matching Requests - keys should remain the same - testing persistency promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'result.text')"
 PASS Cleaning created caches 
-PASS Checking persistency of cache keys 
-PASS Checking persistency of response 
-PASS Checking persistency of response body 
-PASS Testing overriding of an existing cached record that is not in memory 
+FAIL Checking persistency of cache keys assert_equals: expected 1 but got 0
+FAIL Checking persistency of response assert_equals: Cache.put should store the response persistently expected "[object Response]" but got "[object Undefined]"

[Radar WebKit Bug Importer]

<rdar://problem/49236210>

[Shawn Roberts]

Marked as flaky in https://trac.webkit.org/changeset/243473/webkit While waiting for a fix.

[youenn fablet]

*** This bug has been marked as a duplicate of bug 196467 ***