240555 2022-05-17 18:36:33 -0700 REGRESSION(250618@main): [ iOS ] 18X WebPush (API-Tests) are constant failures/timeouts 2022-05-18 10:31:00 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED DUPLICATE 240530 https://bugs.webkit.org/show_bug.cgi?id=240530 InRadar P2 Normal --- 1 jenner webkit-unassigned bfulgham webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1869889 0 jenner 2022-05-17 18:36:33 -0700 The following 18 WebPush API-Tests are constant failures/timeouts on iOS-15 Simulator, and they all appear to have regressed at the same point between 250618@main-250615@main: FAILURES: TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken TestWebKitAPI.WebPushDTest.SubscribeFailureTest TestWebKitAPI.WebPushDTest.SubscribeTest TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe TestWebKitAPI.WebPushDTest.UnsubscribeTest TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest TIMEOUTS: TestWebKitAPI.PushAPI.firePushEvent TestWebKitAPI.WebPushD.PermissionManagement TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush HISTORY: https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode&test=TestWebKitAPI.PushAPI.firePushEvent&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout&test=TestWebKitAPI.WebPushD.PermissionManagement&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush&test=TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken&test=TestWebKitAPI.WebPushDTest.SubscribeFailureTest&test=TestWebKitAPI.WebPushDTest.SubscribeTest&test=TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe&test=TestWebKitAPI.WebPushDTest.UnsubscribeTest&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest URL to recent results: https://build.webkit.org/#/builders/270/builds/1757/steps/18/logs/stdio 1869890 1 webkit-bug-importer 2022-05-17 18:36:52 -0700 <rdar://problem/93468337> 1869893 2 jenner 2022-05-17 18:40:42 -0700 I was able to reproduce all of these failures and timeouts at iOS-15 Debug ToT using the following test: run-api-tests --ios-simulator --release <API-test-name-goes-here> I was also able to narrow down the regression point. I was able to get it to reproduce as far back as 250618@Main, but it was no longer reproducible at 250615@Main. So it's either 250618@Main, 250617@Main, or 250616@Main that appears to have broken these tests. 1870050 3 jenner 2022-05-18 10:08:16 -0700 After looking at the three commits that are in the range, I believe https://commits.webkit.org/250618@main is what have caused these tests to break. 1870063 4 bfulgham 2022-05-18 10:31:00 -0700 *** This bug has been marked as a duplicate of bug 240530 ***