197952 2019-05-16 10:54:01 -0700 Layout Test http/wpt/cache-storage/cache-quota-add.any.html is a flaky failure 2019-05-31 09:39:48 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 sroberts youennf cdumez commit-queue jlewis3 ryanhaddad tsavell webkit-bug-importer youennf oldest_to_newest 1536839 0 sroberts 2019-05-16 10:54:01 -0700 The following layout test is failing on iOS Simulator Release http/wpt/cache-storage/cache-quota-add.any.html Probable cause: Test was added in https://trac.webkit.org/changeset/244918/webkit and is a very consistent failure on iOS Simulator Release. Test is failing, but is a harness timeout I cannot reproduce it locally. I have tried the test by itself with 5000 iterations multiple times. I have tried it in Guard malloc and Asan and still cannot replicate. I have run it with the worker list from run #4135 and cannot get it to fail running that test list, even with 25 iterations. Test list from https://build.webkit.org/builders/Apple%20iOS%2012%20Simulator%20Release%20WK2%20%28Tests%29/builds/4135 Will add additional configuration attempts to reproduce in the Radar. Flakiness Dashboard: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fcache-storage%2Fcache-quota-add.any.html Diff: --- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/wpt/cache-storage/cache-quota-add.any-expected.txt +++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/http/wpt/cache-storage/cache-quota-add.any-actual.txt @@ -1,6 +1,6 @@ -CONSOLE MESSAGE: Cache API operation failed: Quota exceeded -CONSOLE MESSAGE: Cache API operation failed: Quota exceeded -PASS Testing that cache.add checks against quota -PASS Testing that cache.addAll checks against quota +Harness Error (TIMEOUT), message = null +TIMEOUT Testing that cache.add checks against quota Test timed out +NOTRUN Testing that cache.addAll checks against quota + 1536840 1 webkit-bug-importer 2019-05-16 10:54:40 -0700 <rdar://problem/50859168> 1536841 2 370049 youennf 2019-05-16 11:01:02 -0700 Created attachment 370049 Patch 1536851 3 370049 commit-queue 2019-05-16 11:31:29 -0700 Comment on attachment 370049 Patch Clearing flags on attachment: 370049 Committed r245402: <https://trac.webkit.org/changeset/245402> 1536852 4 commit-queue 2019-05-16 11:31:30 -0700 All reviewed patches have been landed. Closing bug. 1537161 5 sroberts 2019-05-17 10:39:28 -0700 After changes in https://trac.webkit.org/changeset/245402 , it looks like the added slow flag worked on iOS. Test is failing with a harness timeout error, but the Diff is slightly different. Still cannot reproduce locally. Youenn do I just need to mark it slow there as well? Or did something else regress this? Diff: --- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/cache-storage/cache-quota-add.any-expected.txt +++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/cache-storage/cache-quota-add.any-actual.txt @@ -1,6 +1,7 @@ -CONSOLE MESSAGE: Cache API operation failed: Quota exceeded CONSOLE MESSAGE: Cache API operation failed: Quota exceeded +Harness Error (TIMEOUT), message = null + PASS Testing that cache.add checks against quota -PASS Testing that cache.addAll checks against quota +TIMEOUT Testing that cache.addAll checks against quota Test timed out 1537162 6 sroberts 2019-05-17 10:42:10 -0700 New Failure is on Mojave Release and Debug 1537163 7 youennf 2019-05-17 10:55:48 -0700 (In reply to Shawn Roberts from comment #6) > New Failure is on Mojave Release and Debug It seems there is a regression, not only this test is affected. 1540742 8 youennf 2019-05-31 09:39:48 -0700 Flakiness dashboard is good now. 370049 2019-05-16 11:01:02 -0700 2019-05-16 11:31:29 -0700 Patch bug-197952-20190516110101.patch text/plain 1582 youennf U3VidmVyc2lvbiBSZXZpc2lvbjogMjQ1MzIxCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggODAyMzYwZDhiODc3NTcyYWIxOTlh NmIwZmI3ZTZjZmNkZDVlODU0Yi4uYzdkNjVmODYwZDE4MzkwNzBmYjUxYjlmNzBlOGNkNGNmYjU2 Y2MxNSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDE0IEBACisyMDE5LTA1LTE2ICBZb3Vlbm4gRmFibGV0ICA8 eW91ZW5uQGFwcGxlLmNvbT4KKworICAgICAgICBMYXlvdXQgVGVzdCBodHRwL3dwdC9jYWNoZS1z dG9yYWdlL2NhY2hlLXF1b3RhLWFkZC5hbnkuaHRtbCBpcyBhIGZsYWt5IGZhaWx1cmUKKyAgICAg ICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTE5Nzk1MgorICAgICAg ICA8cmRhcjovL3Byb2JsZW0vNTA4NTkxNjg+CisKKyAgICAgICAgVW5yZXZpZXdlZC4KKworICAg ICAgICAqIHBsYXRmb3JtL2lvcy1zaW11bGF0b3Itd2syL1Rlc3RFeHBlY3RhdGlvbnM6CisgICAg ICAgIE1hcmsgdGVzdCBhcyBzbG93IGFzIHBlciBmbGFraW5lc3MgZGFzaGJvYXJkLgorCiAyMDE5 LTA1LTE1ICBZb3Vlbm4gRmFibGV0ICA8eW91ZW5uQGFwcGxlLmNvbT4KIAogICAgICAgICBnZXRV c2VyTWVkaWEgc2FuZGJveCBleHRlbnNpb25zIHNob3VsZCBub3QgYmUgcmV2b2tlZCB3aGVuIGEg Z2V0VXNlck1lZGlhIGFsbG93ZWQgcmVxdWVzdCBpcyBiZWluZyBwcm9jZXNzZWQKZGlmZiAtLWdp dCBhL0xheW91dFRlc3RzL3BsYXRmb3JtL2lvcy1zaW11bGF0b3Itd2syL1Rlc3RFeHBlY3RhdGlv bnMgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9pb3Mtc2ltdWxhdG9yLXdrMi9UZXN0RXhwZWN0YXRp b25zCmluZGV4IDcxYTk0Yjk0ZWFmNGNiOTc2Mjk0ZDk4M2M0MjUwNzMxZjg2YmRiOTQuLjIyZmRh NmNlNjZmODYwYjY0NTlkNjI2YjUyYTJhMzk3YTgxODkxMjQgMTAwNjQ0Ci0tLSBhL0xheW91dFRl c3RzL3BsYXRmb3JtL2lvcy1zaW11bGF0b3Itd2syL1Rlc3RFeHBlY3RhdGlvbnMKKysrIGIvTGF5 b3V0VGVzdHMvcGxhdGZvcm0vaW9zLXNpbXVsYXRvci13azIvVGVzdEV4cGVjdGF0aW9ucwpAQCAt ODIsNiArODIsNyBAQCBodHRwL3dwdC9jYWNoZS1zdG9yYWdlL2NhY2hlLXF1b3RhLWFmdGVyLXJl c3RhcnQuYW55Lmh0bWwgWyBTbG93IF0KIGh0dHAvd3B0L2NhY2hlLXN0b3JhZ2UvY2FjaGUtcXVv dGEuYW55Lmh0bWwgWyBTbG93IF0KIGh0dHAvd3B0L2NhY2hlLXN0b3JhZ2UvY2FjaGUtcHV0LWtl eXMuaHR0cHMuYW55Lndvcmtlci5odG1sIFsgU2xvdyBdCiBodHRwL3dwdC9jYWNoZS1zdG9yYWdl L2EtY2FjaGUtb3Blbi5odHRwcy5odG1sIFsgU2xvdyBdCitodHRwL3dwdC9jYWNoZS1zdG9yYWdl L2NhY2hlLXF1b3RhLWFkZC5hbnkuaHRtbCBbIFNsb3cgXQogCiB3ZWJraXQub3JnL2IvMTk2Mzc2 IFsgRGVidWcgXSBzdG9yYWdlL2RvbXN0b3JhZ2UvbG9jYWxzdG9yYWdlL3ByaXZhdGUtYnJvd3Np bmctYWZmZWN0cy1zdG9yYWdlLmh0bWwgWyBQYXNzIEZhaWx1cmUgXQogCg==