Bug 162975

Summary: LayoutTest http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache.html is a flaky failure
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: cdumez, jlewis3, sroberts
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=162686
https://bugs.webkit.org/show_bug.cgi?id=162943

Description Ryan Haddad 2016-10-05 10:20:09 PDT
LayoutTest http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache.html is a flaky failure

https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/194

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcache%2Fdisk-cache%2Fmemory-cache-revalidation-updates-disk-cache.html

--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache-actual.txt
@@ -10,7 +10,7 @@
 Clear the memory cache and load again, it should load from the disk cache *without* revalidation.
 response headers: {"Expires":"now(0)","ETag":"match"}
 response's 'Expires' header is overriden by future date in 304 response
-response source: Disk cache
+response source: Disk cache after validation
 
 PASS successfullyParsed is true
Comment 1 Ryan Haddad 2016-10-07 13:49:20 PDT
Marked as flaky in http://trac.webkit.org/projects/webkit/changeset/206931
Comment 3 Shawn Roberts 2019-03-27 11:00:54 PDT
Test has been showing up on dashboard with iOS Simulator Release and Debug.

Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcache%2Fdisk-cache%2Fmemory-cache-revalidation-updates-disk-cache.html

Reproducible with:

run-webkit-tests http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache.html --iterations 500 --child-process 1 --ios-simulator --no-retry --exit-after-n-failures=10

Will fail approximately 1 in 500 iterations. 

Unable to duplicate locally with Debug builds.

Diff for Release:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/memory-cache-revalidation-updates-disk-cache-actual.txt
@@ -10,7 +10,7 @@
 Clear the memory cache and load again, it should load from the disk cache *without* revalidation.
 response headers: {"Expires":"now(0)","ETag":"match"}
 response's 'Expires' header is overriden by future date in 304 response
-response source: Disk cache
+response source: Disk cache after validation
 
 PASS successfullyParsed is true
 

Updated test expectations to include iOS Sim in https://trac.webkit.org/changeset/243549/webkit