269846 2024-02-21 06:36:36 -0800 getUserMedia camera stream lost on history pushState in iOS 17.4 Beta 4 2024-05-21 14:53:42 -0700 1 1 1 Unclassified WebKit WebRTC Safari 17 iPhone / iPad iOS 17 RESOLVED FIXED https://github.com/pixelverse-llc/gum-camera-lost-after-pushstate InRadar, Regression P1 Major --- 270318 1 alex aestes adamhenson1979 adrien.micol jhenderson2177 webkit-bug-importer youennf oldest_to_newest 2015745 0 alex 2024-02-21 06:36:36 -0800 In iOS 17.4 Beta 4 (and Beta 3 also, did not verify with earlier versions), Safari loses access to the camera stream obtained from getUserMedia() on history.pushState(). As history.pushState() is used in web frameworks for client-side routing, this breaks a lot barcode scanning apps and other apps that rely on the camera stream to be present across navigations. Minimum reproducible sample: https://github.com/pixelverse-llc/gum-camera-lost-after-pushstate 1) Load reproducer page 2) Allow camera access, camera feed is displayed 3) Press 'Push state' button => camera feed is lsot 2015747 1 470000 alex 2024-02-21 06:39:41 -0800 Created attachment 470000 Minimum reproducible sample 2015759 2 webkit-bug-importer 2024-02-21 08:13:53 -0800 <rdar://problem/123381737> 2015760 3 youennf 2024-02-21 08:15:40 -0800 I can reproduce. I wonder whether this is a regression in iOS 17.4. 2015762 4 youennf 2024-02-21 08:17:28 -0800 (In reply to youenn fablet from comment #3) > I can reproduce. > I wonder whether this is a regression in iOS 17.4. Capture is muted and does not recover without a user gesture. Capture should probably not be muted in that case. 2015777 5 alex 2024-02-21 09:20:46 -0800 Hi youenn, thank you for the quick response – much appreciated. I have tested the same sample on iOS 17.3 and it does not exhibit this behavior. 2016024 6 alex 2024-02-22 02:28:42 -0800 Per WebKit bug priority guidelines I'm changing this to P1 (regression from previously released WebKit version) 2016066 7 alex 2024-02-22 06:37:16 -0800 Additional information: this behaviour also occurs if the camera permission setting for the website is "Allow", or the blanket setting for all websites is "Allow", so not presumably not a permission issue. 2016072 8 alex 2024-02-22 07:08:15 -0800 @youenn fablet: what exactly do you mean by "does not recover without a user gesture"? Does it mean the user tapping the crossed-through camera icon in the address bar and selecting "Start using camera"? Or is there a programmatic way, triggered through a touch event, to unmute the track? I extended the reproducer repo with two buttons that do the following: 1) try to unmute track by setting track.enabled = true (does not work) 2) re-acquire MediaStream by releasing old stream/track and obtaining new MediaStream by calling getUserMedia() again (this works, but cumbersome and unexpected) 2016096 9 youennf 2024-02-22 09:02:41 -0800 (In reply to Alex Suzuki from comment #8) > @youenn fablet: what exactly do you mean by "does not recover without a user > gesture"? Does it mean the user tapping the crossed-through camera icon in > the address bar and selecting "Start using camera"? Or is there a > programmatic way, triggered through a touch event, to unmute the track? The former (user tapping the camera icon). No programmatic way unfortunately. We are actively working on fixing this. 2016183 10 aestes 2024-02-22 13:28:24 -0800 Pull request: https://github.com/WebKit/WebKit/pull/24971 2016329 11 alex 2024-02-23 00:07:26 -0800 Thank you so much for the very fast response to this issue. 2016408 12 ews-feeder 2024-02-23 09:54:31 -0800 Committed 275244@main (d97f5a09e4f1): <https://commits.webkit.org/275244@main> Reviewed commits have been landed. Closing PR #24971 and removing active labels. 2017410 13 alex 2024-02-27 23:46:48 -0800 I just checked with the iOS 17.4 Public Beta (build 21E217), and the issue still exists. Does this mean that this fix will not make it into iOS 17.4? 2018818 14 alex 2024-03-05 10:30:43 -0800 Checked with the now release iOS 17.4, unfortunately this is still present and can be easily reproduced with the linked sample. 2022010 15 adamhenson1979 2024-03-18 19:34:43 -0700 Hello - I discovered this issue in iOS 17.4 and also opened a ticket here: https://bugs.webkit.org/show_bug.cgi?id=271127. Sorry for the duplicate as I didn't find this existing bug report. I also added a minimal reproducible sample in the ticket I opened if it helps. I couldn't tell if the PR to fix this didn't make it with the release even though the bug did or if the PR didn't actually fix the issue. Is there any idea when this issue will be fixed? 2022092 16 youennf 2024-03-19 03:28:21 -0700 *** Bug 271127 has been marked as a duplicate of this bug. *** 2022093 17 youennf 2024-03-19 03:29:24 -0700 Bug is fixed in WebKit ToT but I do not think a fix was released in any iOS build yet (stable or beta). I'll try to comment when this gets out for you guys to validate it. 2022105 18 alex 2024-03-19 04:09:36 -0700 The issue is definitely still present in iOS 17.4. I hope it makes it into 17.4.1. 2022127 19 adamhenson1979 2024-03-19 06:45:53 -0700 Thanks @youenn - I appreciate the help. I understand this is a P1 already, but if it helps escalate at all, here are some notes on the level of impact I'm experiencing. Because this is a new regression, introduced in Safari iOS 17.4, I would expect many more reports due to the variety of use cases that could involve a webcam stream and client side navigation. I think the reason there may not be more reports yet is because the issue is difficult to pinpoint in an existing app. Once it is pinpointed however, it is simple to reproduce consistently per Alex's minimum reproducible sample and mine. In these cases, the webcam stream goes completely black, blocking main functionality (like scanning barcodes, taking pictures, etc). I would expect a lot of these cases to involve a highly negative business impact. Speaking for myself, as a software engineer, I found this bug difficult to pinpoint as it was hidden within application code. I'm now faced with the challenge of (temporarily) replacing client side navigation with browser storage functionality, which is a large and delicate task. My workaround is not ideal though as it will degrade the product. And until I'm able to reliably rollout my workaround, large volumes of users are having a poor experience on our website. Anyways, I don't want to add too much noise, but I hope this gets escalated accordingly and hope that my above experience is useful. I'll stay tuned. Thanks again for the help! 2022882 20 alex 2024-03-21 14:24:29 -0700 Issue still occurs in iOS 17.4.1 2024180 21 youennf 2024-03-27 08:21:01 -0700 *** Bug 271637 has been marked as a duplicate of this bug. *** 2025626 22 alex 2024-04-03 00:22:10 -0700 Issue seems to be fixed in iOS 17.5 Developer Beta 1 2025660 23 youennf 2024-04-03 05:41:38 -0700 (In reply to Alex Suzuki from comment #22) > Issue seems to be fixed in iOS 17.5 Developer Beta 1 2029766 24 ahmad.saleem792 2024-04-19 02:58:59 -0700 *** Bug 272704 has been marked as a duplicate of this bug. *** 2035349 25 adamhenson1979 2024-05-14 13:14:42 -0700 I'm seeing this issue now in Chrome for iOS version 124.0.6367.111 via this reproduction link: https://get-user-media-sage.vercel.app/ Description of the repro link: https://github.com/adamhenson/get-user-media Is it known that this exists not just in Safari for iOS but also Chrome for iOS? Will the PR from this comment (https://bugs.webkit.org/show_bug.cgi?id=269846#c12)in iOS 17.5 stable for all Webkit browsers (not just Safari for iOS)? 2035366 26 ap 2024-05-14 14:24:26 -0700 This fix was in WebKit code, and would apply to all clients. There may be additional issues though. If you are still seeing similar issues in iOS 17.5, including in Chrome, please file a new bug with an example, steps to reproduce, and anything you know about when this last worked. Ideally, please have everything in the bug report, clicking through to other bugs or GitHub takes time and increases confusion. 2036827 27 adamhenson1979 2024-05-21 14:53:42 -0700 I just wanted to follow up here to comment that I tested and confirmed fix in 17.5.0 (tested on 17.5.1 using my repro from https://bugs.webkit.org/show_bug.cgi?id=271127). Thank you all for the swift help / turnaround and thank you Andy Estes for the fix. 470000 2024-02-21 06:39:41 -0800 2024-02-21 06:39:41 -0800 Minimum reproducible sample index.html text/html 1587 alex PCFET0NUWVBFIGh0bWw+CjxodG1sIGxhbmc9ImVuIj4KPGhlYWQ+CiAgICA8bWV0YSBjaGFyc2V0 PSJVVEYtOCI+CiAgICA8bWV0YSBuYW1lPSJ2aWV3cG9ydCIgY29udGVudD0id2lkdGg9ZGV2aWNl LXdpZHRoLCBpbml0aWFsLXNjYWxlPTEuMCwgbWF4aW11bS1zY2FsZT0xLjAsIHVzZXItc2NhbGFi bGU9bm8iPgogICAgPHRpdGxlPmlPUyAxNy40IEJldGEgNCBsb3NlcyBjYW1lcmEgYWNjZXNzIG9u IHB1c2hTdGF0ZTwvdGl0bGU+CiAgICA8c3R5bGU+CgogICAgICAgICNjYW1lcmFfc3RyZWFtIHsK ICAgICAgICAgICAgd2lkdGg6IDEwMCU7CiAgICAgICAgICAgIGhlaWdodDogMzAwcHg7CiAgICAg ICAgICAgIG9iamVjdC1maXQ6IGNvdmVyOwogICAgICAgIH0KICAgIDwvc3R5bGU+CjwvaGVhZD4K PGJvZHk+Cgo8aDE+aU9TIDE3LjQgQmV0YSA0IGxvc2VzIGNhbWVyYSBhY2Nlc3Mgb24gaGlzdG9y eS5wdXNoU3RhdGUoKTwvaDE+Cgo8dmlkZW8gaWQ9ImNhbWVyYV9zdHJlYW0iIG11dGVkIHBsYXlz aW5saW5lPgoKPC92aWRlbz4KCjxkaXY+CiAgICA8YnV0dG9uIGlkPSJwdXNoU3RhdGVCdXR0b24i PlB1c2ggU3RhdGU8L2J1dHRvbj4KICAgIDxidXR0b24gaWQ9ImJhY2tCdXR0b24iPkJhY2s8L2J1 dHRvbj4KPC9kaXY+Cgo8c2NyaXB0PgogICAgY29uc3QgdmlkZW9FbGVtZW50ID0gZG9jdW1lbnQu Z2V0RWxlbWVudEJ5SWQoJ2NhbWVyYV9zdHJlYW0nKTsKICAgIG5hdmlnYXRvci5tZWRpYURldmlj ZXMuZ2V0VXNlck1lZGlhKHsKICAgICAgICB2aWRlbzogewogICAgICAgICAgICBmYWNpbmdNb2Rl OiB7CiAgICAgICAgICAgICAgICBpZGVhbDogJ2Vudmlyb25tZW50JwogICAgICAgICAgICB9CiAg ICAgICAgfSwKICAgICAgICBhdWRpbzogZmFsc2UKICAgIH0pLnRoZW4oKG1lZGlhU3RyZWFtKSA9 PiB7CiAgICAgICAgdmlkZW9FbGVtZW50Lm9ubG9hZGVkbWV0YWRhdGEgPSAoKSA9PiB7CiAgICAg ICAgICAgIHZpZGVvRWxlbWVudC5wbGF5KCk7CiAgICAgICAgfTsKICAgICAgICB2aWRlb0VsZW1l bnQuc3JjT2JqZWN0ID0gbWVkaWFTdHJlYW07CiAgICB9KQogICAgLmNhdGNoKChlcnIpID0+IHsK ICAgICAgICB3aW5kb3cuYWxlcnQoJ2dldFVzZXJNZWRpYSBmYWlsZWQ6ICcgKyBlcnIpOwogICAg fSk7CgogICAgbGV0IHN0ZXAgPSAwOwogICAgZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQoJ3B1c2hT dGF0ZUJ1dHRvbicpLm9uY2xpY2sgPSAoKSA9PiB7CiAgICAgICAgc3RlcCsrOwogICAgICAgIGhp c3RvcnkucHVzaFN0YXRlKHsgc3RlcCB9LCAnJywgJy9zdGVwJyArIHN0ZXAudG9TdHJpbmcoKSk7 CiAgICAgICAgZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQoJ2JhY2tCdXR0b24nKS5kaXNhYmxlZCA9 IGZhbHNlOwogICAgfTsKICAgIGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKCdiYWNrQnV0dG9uJyku b25jbGljayA9ICgpID0+IHsKICAgICAgICBzdGVwLS07CiAgICAgICAgaGlzdG9yeS5iYWNrKCk7 CiAgICAgICAgZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQoJ2JhY2tCdXR0b24nKS5kaXNhYmxlZCA9 IChzdGVwID09PSAwKTsKICAgIH0KPC9zY3JpcHQ+Cgo8L2JvZHk+CjwvaHRtbD4K