http/tests/appcache/404-resource-with-slow-main-resource.php is flaky

• Component: Tools / Tests
• Status: NEW ---

[Ryan Haddad]

[iOS Simulator] http/tests/appcache/404-resource-with-slow-main-resource.php is flaky

The first failure according to the flakiness dashboard was r195567, and it has been flaky since:
<https://build.webkit.org/builders/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/builds/2563>

<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fappcache%2F404-resource-with-slow-main-resource.php>

--- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-actual.txt
@@ -1,3 +1,2 @@
-CONSOLE MESSAGE: Application Cache update failed, because http://127.0.0.1:8000/appcache/resources/does-not-exist.txt could not be fetched.
 This tests that a manifest that contains a missing file will not crash the browser even if the main resource keeps loading after the error occurs.
 SUCCESS

[Ryan Haddad]

Marked as flaky on ios-simulator-wk2 with <https://trac.webkit.org/r195978>

[Alexey Proskuryakov]

*** Bug 172241 has been marked as a duplicate of this bug. ***

[Alexey Proskuryakov]

This kind of failure is well understood, and we may have older bugs tracking flakiness on other appcache tests.

Due to the async nature of appcache, we can't guarantee that expected failures occur while the test is still running. We will need to add synchronization support in WebCore for appcache tests to be reliable.

<rdar://problem/32256665>

[Ryan Haddad]

Marked as flaky on mac-wk1 in http://trac.webkit.org/projects/webkit/changeset/217007

[Matt Lewis]

This has now begun to flake on all platforms but now has a different diff:

--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/http/tests/appcache/404-resource-with-slow-main-resource-actual.txt
@@ -1,4 +1,3 @@
 CONSOLE MESSAGE: line 1: ApplicationCache is deprecated. Please use ServiceWorkers instead.
-CONSOLE MESSAGE: Application Cache update failed, because http://127.0.0.1:8000/appcache/resources/does-not-exist.txt could not be fetched.
 This tests that a manifest that contains a missing file will not crash the browser even if the main resource keeps loading after the error occurs.
 SUCCESS

https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/r228919%20(3084)/results.html
https://build.webkit.org/builders/Apple%20High%20Sierra%20Release%20WK2%20(Tests)/builds/3084

[Matt Lewis]

Updated expectations in https://trac.webkit.org/changeset/228921/webkit

[Alexey Proskuryakov]

*** Bug 207792 has been marked as a duplicate of this bug. ***