Bug 162685 - LayoutTest http/tests/cache/disk-cache/disk-cache-204-status-code.html is a flaky failure
Summary: LayoutTest http/tests/cache/disk-cache/disk-cache-204-status-code.html is a f...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-09-28 10:16 PDT by Ryan Haddad
Modified: 2018-07-27 15:57 PDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-09-28 10:16:12 PDT
LayoutTest http/tests/cache/disk-cache/disk-cache-204-status-code.html is a flaky failure

https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/90

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fcache%2Fdisk-cache%2Fdisk-cache-204-status-code.html

--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/disk-cache-204-status-code-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/disk-cache-204-status-code-actual.txt
@@ -17,7 +17,7 @@
 
 --------Testing loads through memory cache (XHR behavior)--------
 response headers: {"Status":"204","Cache-control":"max-age=0"}
-response source: Network
+response source: Memory cache
 
 response headers: {"Status":"204","Cache-control":"max-age=100"}
 response source: Memory cache
@@ -27,7 +27,7 @@
 
 --------Testing loads through memory cache (subresource behavior)--------
 response headers: {"Status":"204","Cache-control":"max-age=0"}
-response source: Network
+response source: Memory cache
 
 response headers: {"Status":"204","Cache-control":"max-age=100"}
 response source: Memory cache
Comment 1 Ryan Haddad 2016-09-28 10:17:38 PDT
Seeing this failure on  Sierra Debug WK2,  Sierra Release WK2, El Capitan Debug WK2, and iOS 10 Simulator Release WK2.
Comment 2 Ryan Haddad 2016-09-28 10:18:32 PDT
Earliest failure on the flakiness dashboard was around r205357
Comment 3 Ryan Haddad 2016-10-04 11:48:07 PDT
Marked test as flaky on mac-wk2 in http://trac.webkit.org/projects/webkit/changeset/206775
Comment 4 Carlos Alberto Lopez Perez 2017-02-23 08:49:50 PST
The same happens on the GTK+ port.

It fails sometimes, with the diff below which looks the same:

https://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r212883%20%2821059%29/http/tests/cache/disk-cache/disk-cache-204-status-code-pretty-diff.html

I have marked it on the gtk TestExpectation file as flaky also in https://trac.webkit.org/changeset/212890
Comment 6 Dawei Fenton (:realdawei) 2018-07-27 15:57:27 PDT
This failure is now flaky on the iOS Release testers as well:

--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/disk-cache-204-status-code-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/cache/disk-cache/disk-cache-204-status-code-actual.txt
@@ -17,7 +17,7 @@
 
 --------Testing loads through memory cache (XHR behavior)--------
 response headers: {"Status":"204","Cache-control":"max-age=0"}
-response source: Network
+response source: Memory cache
 
 response headers: {"Status":"204","Cache-control":"max-age=100"}
 response source: Memory cache
@@ -27,7 +27,7 @@
 
 --------Testing loads through memory cache (subresource behavior)--------
 response headers: {"Status":"204","Cache-control":"max-age=0"}
-response source: Network
+response source: Memory cache
 
 response headers: {"Status":"204","Cache-control":"max-age=100"}
 response source: Memory cache


marked as flaky on iOS Release: https://trac.webkit.org/changeset/234336/webkit