203732 2019-11-01 06:02:06 -0700 Flaky API Test TestWebKitAPI.WebKit.ApplicationCacheDirectories 2019-11-13 15:51:55 -0800 1 1 1 Unclassified WebKit Tools / Tests Other Unspecified Unspecified RESOLVED DUPLICATE 203734 InRadar P2 Normal --- 1 aakash_jain webkit-unassigned aakash_jain achristensen ap jbedard webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1586327 0 aakash_jain 2019-11-01 06:02:06 -0700 TestWebKitAPI.WebKit.ApplicationCacheDirectories seems flaky on iOS. In https://ews-build.webkit.org/#/builders/9/builds/11269, the test failed in run-api-tests step. However, in the immediately next retry step (re-run-api-tests), it passed. Also, this test failed on clean tree in https://ews-build.webkit.org/#/builders/9/builds/11291/steps/13/logs/json 1586328 1 aakash_jain 2019-11-01 06:03:52 -0700 This test was added 3 months back in https://trac.webkit.org/changeset/247686/webkit 1586333 2 webkit-bug-importer 2019-11-01 06:20:40 -0700 <rdar://problem/56814641> 1586336 3 aakash_jain 2019-11-01 06:27:41 -0700 This test flaked in https://ews-build.webkit.org/#/builders/9/builds/11281 as well. 1586338 4 aakash_jain 2019-11-01 06:50:59 -0700 Flaked again in https://ews-build.webkit.org/#/builders/9/builds/11296 and https://ews-build.webkit.org/#/builders/9/builds/11297 1586598 5 aakash_jain 2019-11-01 15:13:19 -0700 This test has become too much flaky recently and slowing down EWS. This failure/flakiness started yesterday, and was first seen in: https://ews-build.webkit.org/#/builders/9/builds/11260 More examples of flakiness/failures: https://ews-build.webkit.org/#/builders/9/builds/11307 https://ews-build.webkit.org/#/builders/9/builds/11314 https://ews-build.webkit.org/#/builders/9/builds/11318 https://ews-build.webkit.org/#/builders/9/builds/11320 1586851 6 ap 2019-11-03 10:36:01 -0800 There isn't much in this test to tie out on, unless TCPServer is broken... 1586852 7 ap 2019-11-03 10:37:05 -0800 Looks like another one that isn't failing in post-commit testing. 1586871 8 aakash_jain 2019-11-03 15:31:59 -0800 (In reply to Alexey Proskuryakov from comment #7) > Looks like another one that isn't failing in post-commit testing. Yes, also this test isn't failing on EWS bots which are on Catalina (ews156 and ews157), it is only failing/flaky on bots which are on Mojave (ews158 and ews159). 1586931 9 achristensen 2019-11-04 03:28:32 -0800 Do we know when this flakiness started? I don't have a Mojave machine with me, so this won't be investigated this week. Could we disable this test on Mojave for now? 1589825 10 aakash_jain 2019-11-13 05:46:00 -0800 Committed r252404: <https://trac.webkit.org/changeset/252404> 1589826 11 aakash_jain 2019-11-13 05:46:53 -0800 (In reply to Alex Christensen from comment #9) > Do we know when this flakiness started? First failure was noticed in https://ews-build.webkit.org/#/builders/9/builds/11260 on Oct 31st. > I don't have a Mojave machine with me, so this won't be investigated this > week. Could we disable this test on Mojave for now? I don't think we have a way to disable API tests on specific platforms. I have disabled this test for now. This is still flaking frequently and causing false-positives on EWS: https://ews-build.webkit.org/#/builders/9/builds/11936 https://ews-build.webkit.org/#/builders/9/builds/11928 https://ews-build.webkit.org/#/builders/9/builds/11884 https://ews-build.webkit.org/#/builders/9/builds/11876 1590076 12 achristensen 2019-11-13 15:51:55 -0800 *** This bug has been marked as a duplicate of bug 203734 ***