Bug 206956 – Flaky API Test: TestWebKitAPI.WebKitLegacy.CrossPartitionFileSchemeAccess

• Status: NEW
• Component: New Bugs

[Aakash Jain]

TestWebKitAPI.WebKitLegacy.CrossPartitionFileSchemeAccess seems flaky on macOS. In https://ews-build.webkit.org/#/builders/3/builds/16434, the test TimedOut in run-api-tests step. However, in the immediately next retry step (re-run-api-tests), it passed.

[Ryan Haddad]

Looking at: https://results.webkit.org/?suite=api-tests&test=TestWTF.FileSystemTest.MappingExistingFile

The test timed out on trunk bots between r254548 and r254560 (which rolled out r254548), and one time on 12/29/2019 @r253935.

[Ryan Haddad]

Correct link for result history: https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.WebKitLegacy.CrossPartitionFileSchemeAccess

[Radar WebKit Bug Importer]

<rdar://problem/63104186>

[Ryan Haddad]

This test has started timing out on almost every Mojave API test run. It had been frequently timing out on debug only, but now it is timing out on release, too.

[Ryan Haddad]

(In reply to Ryan Haddad from comment #4)
> This test has started timing out on almost every Mojave API test run. It had
> been frequently timing out on debug only, but now it is timing out on
> release, too.
My statement should be reversed: it was frequently timing out on release, now it times out on debug too.

[Ryan Haddad]

Disabled the test for Mojave in r262851.

[Aakash Jain]

Now that EWS bots have moved to Catalina, this test is now very flaky on EWS. e.g.:
https://ews-build.webkit.org/#/builders/3/builds/40455
https://ews-build.webkit.org/#/builders/3/builds/40454
https://ews-build.webkit.org/#/builders/3/builds/40452
https://ews-build.webkit.org/#/builders/3/builds/40434
https://ews-build.webkit.org/#/builders/3/builds/40274

[Alex Christensen]

Created attachment 419147 [details]
Patch

[Alexey Proskuryakov]

Comment on attachment 419147 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=419147&action=review

> Tools/ChangeLog:9
> +        Don't hide the output of hdiutil so we can see what is happening on the bots.

Does the error actually go to stdout, not stderr?

[Alex Christensen]

Comment on attachment 419147 [details]
Patch

Nothing goes to stderr.  A description of what it has done goes to stdout.

[Alex Christensen]

Comment on attachment 419147 [details]
Patch

r272323
Now let's see what happens when it times out...

[Ryan Haddad]

(In reply to Alex Christensen from comment #11)
> Comment on attachment 419147 [details]
> Patch
> 
> r272323
> Now let's see what happens when it times out...
from https://ews-build.webkit.org/#/builders/3/builds/41044/steps/19/logs/stdio (using r272678):
    TestWebKitAPI.WebKitLegacy.CrossPartitionFileSchemeAccess
        Cleaning up from previous run...
        hdiutil: detach failed - No such file or directory
        Creating partition...

[Aakash Jain]

This test is still flaky and slowing down EWS api-mac queue.

e.g.: 
https://ews-build.webkit.org/#/builders/3/builds/41159
https://ews-build.webkit.org/#/builders/3/builds/41154
https://ews-build.webkit.org/#/builders/3/builds/41145
https://ews-build.webkit.org/#/builders/3/builds/41136

[Alex Christensen]

r272765 should make EWS happy for another year.
I still have no idea why it is timing out only on EWS bots.