Bug 245855 - REGRESSION (iOS16): [ iOS ] Two TestWebKitAPI.WKWebViewCloseAllMediaPresentations tests are a flaky timeout
Summary: REGRESSION (iOS16): [ iOS ] Two TestWebKitAPI.WKWebViewCloseAllMediaPresentat...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-09-29 17:01 PDT by Karl Rackler
Modified: 2023-05-09 13:17 PDT (History)
5 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-09-29 17:01:45 PDT 
Description:
TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture

The first flaky timeout I saw on the dashboard was on 9/14/2022 at 254499@main after the upgrade from iOS 15 to iOS16 on the bots.  These are only flaky timeouts on iOS16 using the iPad (9th generation) model.

Reproduction steps:
I can reproduce this on 255006@main ToT.

Command: 
run-api-tests --iterations 15 --ipad-simulator --model 'iPad (9th generation)' TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture

History:
https://results.webkit.org/?platform=ios&limit=50000&recent=false&suite=api-tests&suite=api-tests&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture

Timeout
    TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture
    TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture
Comment 1 Radar WebKit Bug Importer 2022-09-29 17:02:11 PDT 
<rdar://problem/100588574>
Comment 2 Ryan Haddad 2023-05-09 13:15:17 PDT 
https://results.webkit.org/?platform=ios&limit=50000&recent=false&suite=api-tests&suite=api-tests&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture&architecture=arm64&architecture=x86_64 suggests that this test was timing out when the bots running simulator tests were x86, but once we switched to arm64 + iOS 16.4 (simultaneously) the tests are no longer timing out.