Bug 240555 – REGRESSION(250618@main): [ iOS ] 18X WebPush (API-Tests) are constant failures/timeouts

• Status: RESOLVED
• Resolution: DUPLICATE
• Component: Tools / Tests

[Robert Jenner]

The following 18 WebPush API-Tests are constant failures/timeouts on iOS-15 Simulator, and they all appear to have regressed at the same point between 250618@main-250615@main:

FAILURES: 
TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode 
TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail
TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful
TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout
TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken
TestWebKitAPI.WebPushDTest.SubscribeFailureTest
TestWebKitAPI.WebPushDTest.SubscribeTest
TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe
TestWebKitAPI.WebPushDTest.UnsubscribeTest
TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData
TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin
TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset
TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest

TIMEOUTS:
TestWebKitAPI.PushAPI.firePushEvent
TestWebKitAPI.WebPushD.PermissionManagement
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode&test=TestWebKitAPI.PushAPI.firePushEvent&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout&test=TestWebKitAPI.WebPushD.PermissionManagement&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush&test=TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken&test=TestWebKitAPI.WebPushDTest.SubscribeFailureTest&test=TestWebKitAPI.WebPushDTest.SubscribeTest&test=TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe&test=TestWebKitAPI.WebPushDTest.UnsubscribeTest&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest

URL to recent results: 
https://build.webkit.org/#/builders/270/builds/1757/steps/18/logs/stdio

[Radar WebKit Bug Importer]

<rdar://problem/93468337>

[Robert Jenner]

I was able to reproduce all of these failures and timeouts at iOS-15 Debug ToT using the following test:

run-api-tests --ios-simulator --release <API-test-name-goes-here>


I was also able to narrow down the regression point. I was able to get it to reproduce as far back as 250618@Main, but it was no longer reproducible at 250615@Main. 


So it's either 250618@Main, 250617@Main, or 250616@Main that appears to have broken these tests.

[Robert Jenner]

After looking at the three commits that are in the range, I believe https://commits.webkit.org/250618@main is what have caused these tests to break.

[Brent Fulgham]

*** This bug has been marked as a duplicate of bug 240530 ***