Bug 153503 - http/tests/appcache/404-resource-with-slow-main-resource.php is flaky
Summary: http/tests/appcache/404-resource-with-slow-main-resource.php is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: iPhone / iPad iOS 9.0
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 172241 (view as bug list)
Depends on:
Blocks: 152130
  Show dependency treegraph
 
Reported: 2016-01-26 12:37 PST by Ryan Haddad
Modified: 2018-02-23 09:33 PST (History)
7 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-01-26 12:37:07 PST
[iOS Simulator] http/tests/appcache/404-resource-with-slow-main-resource.php is flaky

The first failure according to the flakiness dashboard was r195567, and it has been flaky since:
<https://build.webkit.org/builders/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/builds/2563>

<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fappcache%2F404-resource-with-slow-main-resource.php>

--- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-actual.txt
@@ -1,3 +1,2 @@
-CONSOLE MESSAGE: Application Cache update failed, because http://127.0.0.1:8000/appcache/resources/does-not-exist.txt could not be fetched.
 This tests that a manifest that contains a missing file will not crash the browser even if the main resource keeps loading after the error occurs.
 SUCCESS
Comment 1 Ryan Haddad 2016-02-01 13:52:50 PST
Marked as flaky on ios-simulator-wk2 with <https://trac.webkit.org/r195978>
Comment 2 Alexey Proskuryakov 2017-05-17 15:24:11 PDT
*** Bug 172241 has been marked as a duplicate of this bug. ***
Comment 3 Alexey Proskuryakov 2017-05-17 15:27:07 PDT
This kind of failure is well understood, and we may have older bugs tracking flakiness on other appcache tests.

Due to the async nature of appcache, we can't guarantee that expected failures occur while the test is still running. We will need to add synchronization support in WebCore for appcache tests to be reliable.

<rdar://problem/32256665>
Comment 4 Ryan Haddad 2017-05-17 16:17:06 PDT
Marked as flaky on mac-wk1 in http://trac.webkit.org/projects/webkit/changeset/217007
Comment 5 Matt Lewis 2018-02-22 10:11:19 PST
This has now begun to flake on all platforms but now has a different diff:

--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-actual.txt
@@ -1,4 +1,3 @@
 CONSOLE MESSAGE: line 1: ApplicationCache is deprecated. Please use ServiceWorkers instead.
-CONSOLE MESSAGE: Application Cache update failed, because http://127.0.0.1:8000/appcache/resources/does-not-exist.txt could not be fetched.
 This tests that a manifest that contains a missing file will not crash the browser even if the main resource keeps loading after the error occurs.
 SUCCESS

https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/r228919%20(3084)/results.html
https://build.webkit.org/builders/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/builds/3084
Comment 6 Matt Lewis 2018-02-22 10:22:54 PST
Updated expectations in https://trac.webkit.org/changeset/228921/webkit