Bug 173672 - Multiple Layout Tests from imported/w3c/web-platform-tests/fetch/http-cache/ are flaky.
Summary: Multiple Layout Tests from imported/w3c/web-platform-tests/fetch/http-cache/ ...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-06-21 15:31 PDT by Matt Lewis
Modified: 2017-08-22 11:00 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-21 15:31:53 PDT
Multiple test from imported/w3c/web-platform-tests/fetch/http-cache/ are flaky:
  imported/w3c/web-platform-tests/fetch/http-cache/cc-request.html
  imported/w3c/web-platform-tests/fetch/http-cache/heuristic.html
  imported/w3c/web-platform-tests/fetch/http-cache/invalidate.html
  imported/w3c/web-platform-tests/fetch/http-cache/status.html

According to the Flakiness Dashboard, these 4 test have failed together consistently, particularly on Sierra WK2 Debug, recently.

imported/w3c/web-platform-tests/fetch/http-cache/invalidate.html can fail on its own, but the other test always fail together with imported/w3c/web-platform-tests/fetch/http-cache/invalidate.html.

https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r218641%20(1674)/results.html
https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/1674


diff for imported/w3c/web-platform-tests/fetch/http-cache/invalidate.html
--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/fetch/http-cache/invalidate-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/fetch/http-cache/invalidate-actual.txt
@@ -1,7 +1,7 @@
 
 PASS HTTP cache invalidates after a successful response from a POST 
-FAIL HTTP cache does not invalidate after a failed response from an unsafe request assert_less_than: Response used expected a number less than 3 but got 3
-PASS HTTP cache invalidates after a successful response from a PUT 
+PASS HTTP cache does not invalidate after a failed response from an unsafe request 
+FAIL HTTP cache invalidates after a successful response from a PUT assert_equals: Response used expected 3 but got 2
 PASS HTTP cache invalidates after a successful response from a DELETE 
 PASS HTTP cache invalidates after a successful response from an unknown method 
 FAIL HTTP cache invalidates Location URL after a successful response from a POST assert_equals: Response used expected 3 but got 1
Comment 1 Matt Lewis 2017-08-22 11:00:41 PDT
Marked imported/w3c/web-platform-tests/fetch/http-cache/invalidate.html as flaky on macOS WK2:
https://trac.webkit.org/changeset/221023/webkit