Bug 269846 – getUserMedia camera stream lost on history pushState in iOS 17.4 Beta 4

• Status: RESOLVED
• Resolution: FIXED
• Component: WebRTC

[Alex Suzuki]

In iOS 17.4 Beta 4 (and Beta 3 also, did not verify with earlier versions), Safari loses access to the camera stream obtained from getUserMedia() on history.pushState().

As history.pushState() is used in web frameworks for client-side routing, this breaks a lot barcode scanning apps and other apps that rely on the camera stream to be present across navigations.

Minimum reproducible sample:
https://github.com/pixelverse-llc/gum-camera-lost-after-pushstate

1) Load reproducer page
2) Allow camera access, camera feed is displayed
3) Press 'Push state' button => camera feed is lsot

[Alex Suzuki]

Created attachment 470000 [details]
Minimum reproducible sample

[Radar WebKit Bug Importer]

<rdar://problem/123381737>

[youenn fablet]

I can reproduce.
I wonder whether this is a regression in iOS 17.4.

[youenn fablet]

(In reply to youenn fablet from comment #3)
> I can reproduce.
> I wonder whether this is a regression in iOS 17.4.

Capture is muted and does not recover without a user gesture.
Capture should probably not be muted in that case.

[Alex Suzuki]

Hi youenn, thank you for the quick response – much appreciated.
I have tested the same sample on iOS 17.3 and it does not exhibit this behavior.

[Alex Suzuki]

Per WebKit bug priority guidelines I'm changing this to P1 (regression from previously released WebKit version)

[Alex Suzuki]

Additional information: this behaviour also occurs if the camera permission setting for the website is "Allow", or the blanket setting for all websites is "Allow", so not presumably not a permission issue.

[Alex Suzuki]

@youenn fablet: what exactly do you mean by "does not recover without a user gesture"? Does it mean the user tapping the crossed-through camera icon in the address bar and selecting "Start using camera"? Or is there a programmatic way, triggered through a touch event, to unmute the track?

I extended the reproducer repo with two buttons that do the following:
1) try to unmute track by setting track.enabled = true (does not work)
2) re-acquire MediaStream by releasing old stream/track and obtaining new MediaStream by calling getUserMedia() again (this works, but cumbersome and unexpected)

[youenn fablet]

(In reply to Alex Suzuki from comment #8)
> @youenn fablet: what exactly do you mean by "does not recover without a user
> gesture"? Does it mean the user tapping the crossed-through camera icon in
> the address bar and selecting "Start using camera"? Or is there a
> programmatic way, triggered through a touch event, to unmute the track?

The former (user tapping the camera icon).
No programmatic way unfortunately.
We are actively working on fixing this.

[Andy Estes]

Pull request: https://github.com/WebKit/WebKit/pull/24971

[Alex Suzuki]

Thank you so much for the very fast response to this issue.

[EWS]

Committed 275244@main (d97f5a09e4f1): <https://commits.webkit.org/275244@main>

Reviewed commits have been landed. Closing PR #24971 and removing active labels.

[Alex Suzuki]

I just checked with the iOS 17.4 Public Beta (build 21E217), and the issue still exists. Does this mean that this fix will not make it into iOS 17.4?

[Alex Suzuki]

Checked with the now release iOS 17.4, unfortunately this is still present and can be easily reproduced with the linked sample.

[Adam]

Hello - I discovered this issue in iOS 17.4 and also opened a ticket here: https://bugs.webkit.org/show_bug.cgi?id=271127. Sorry for the duplicate as I didn't find this existing bug report. I also added a minimal reproducible sample in the ticket I opened if it helps.

I couldn't tell if the PR to fix this didn't make it with the release even though the bug did or if the PR didn't actually fix the issue.

Is there any idea when this issue will be fixed?

[youenn fablet]

*** Bug 271127 has been marked as a duplicate of this bug. ***

[youenn fablet]

Bug is fixed in WebKit ToT but I do not think a fix was released in any iOS build yet (stable or beta).

I'll try to comment when this gets out for you guys to validate it.

[Alex Suzuki]

The issue is definitely still present in iOS 17.4. I hope it makes it into 17.4.1.

[Adam]

Thanks @youenn - I appreciate the help. I understand this is a P1 already, but if it helps escalate at all, here are some notes on the level of impact I'm experiencing.

Because this is a new regression, introduced in Safari iOS 17.4, I would expect many more reports due to the variety of use cases that could involve a webcam stream and client side navigation. I think the reason there may not be more reports yet is because the issue is difficult to pinpoint in an existing app. Once it is pinpointed however, it is simple to reproduce consistently per Alex's minimum reproducible sample and mine. In these cases, the webcam stream goes completely black, blocking main functionality (like scanning barcodes, taking pictures, etc). I would expect a lot of these cases to involve a highly negative business impact. Speaking for myself, as a software engineer, I found this bug difficult to pinpoint as it was hidden within application code. I'm now faced with the challenge of (temporarily) replacing client side navigation with browser storage functionality, which is a large and delicate task. My workaround is not ideal though as it will degrade the product. And until I'm able to reliably rollout my workaround, large volumes of users are having a poor experience on our website.

Anyways, I don't want to add too much noise, but I hope this gets escalated accordingly and hope that my above experience is useful. I'll stay tuned.

Thanks again for the help!

[Alex Suzuki]

Issue still occurs in iOS 17.4.1

[youenn fablet]

*** Bug 271637 has been marked as a duplicate of this bug. ***

[Alex Suzuki]

Issue seems to be fixed in iOS 17.5 Developer Beta 1

[youenn fablet]

(In reply to Alex Suzuki from comment #22)
> Issue seems to be fixed in iOS 17.5 Developer Beta 1

[Ahmad Saleem]

*** Bug 272704 has been marked as a duplicate of this bug. ***

[Adam]

I'm seeing this issue now in Chrome for iOS version 124.0.6367.111 via this reproduction link: https://get-user-media-sage.vercel.app/

Description of the repro link: https://github.com/adamhenson/get-user-media

Is it known that this exists not just in Safari for iOS but also Chrome for iOS?

Will the PR from this comment (https://bugs.webkit.org/show_bug.cgi?id=269846#c12)in iOS 17.5 stable for all Webkit browsers (not just Safari for iOS)?

[Alexey Proskuryakov]

This fix was in WebKit code, and would apply to all clients. There may be additional issues though.

If you are still seeing similar issues in iOS 17.5, including in Chrome, please file a new bug with an example, steps to reproduce, and anything you know about when this last worked. Ideally, please have everything in the bug report, clicking through to other bugs or GitHub takes time and increases confusion.

[Adam]

I just wanted to follow up here to comment that I tested and confirmed fix in 17.5.0 (tested on 17.5.1 using my repro from https://bugs.webkit.org/show_bug.cgi?id=271127).

Thank you all for the swift help / turnaround and thank you Andy Estes for the fix.