230922 2021-09-28 16:05:09 -0700 REGRESSION (iOS 15): Autoplayed video element with mediaStream srcObject freezes 2023-11-17 00:19:14 -0800 1 1 1 Unclassified WebKit Media Other iPhone / iPad Other RESOLVED CONFIGURATION CHANGED InRadar P2 Normal --- 1 abargas webkit-unassigned 908589510 cdumez chris.mo csantos ddp.bkdn electroteque eric.carlson jameshoward jean-yves.avenard jer.noble Kongpheng.Nanthavongsa lprenji mark.burrett peng.liu6 steve.mieskoski+webkit webkit-bug-importer will.morgan yevhen.lv.developer youennf oldest_to_newest 1798093 0 abargas 2021-09-28 16:05:09 -0700 A video element with the 'autoplay + playsinline + muted' property set with a mediaStream srcObject can freeze. This freeze can either occur before the video starts playing (so the background is seen) or a single frame is frozen. The expectation is that the video should play continuously without freezing. This behavior can be seen on the https://webrtc.github.io/samples/src/content/capture/canvas-video/ sample page. The steps to reproduce the bug are: 1. Navigate to page. 2. Drag on the canvas (first teapot if two exist) and observe. 3a. If after dragging, a second teapot (appears if one didn't exist before and) moves, then the issue did not reproduce (move on to 4a). 3b. If after dragging a second teapot did not move, then the issue was reproduced and no need to follow the next steps. 4a. Close the tab, kill Safari, and relaunch Safari. 5a. From history, select the sample page. 6a. Drag on the canvas and observe, the issue should be seen. When this happens, the media stream and tracks are still active and the video element is not paused. If the video is unmuted and the stream includes audio, the audio will still play. If using an iPad, putting Safari into split screen updates the video to what looks like the most recent frame, but the video still does not update continuously. On either iPad or iPhone, backgrounding Safari then coming back will allow the video to update continuously. Reproduces with: Version/15.0 Safari/605.1.15 (iOS 15.0) Version/15.0 Safari/605.1.15 (iPadOS 15.1) Does not reproduce with: Prior to iOS 15 beta 8 Version/14.1.2 Safari/605.1.15 (macOS Big Sur 11.6) 1798507 1 webkit-bug-importer 2021-09-29 12:53:26 -0700 <rdar://problem/83684099> 1799373 2 will.morgan 2021-10-01 10:20:49 -0700 This regression is affecting a number of our users and is blocking them from advancing through several important user journeys - authenticating to banks and healthcare etc. Could this be looked at urgently? 1800026 3 mark.burrett 2021-10-04 04:20:19 -0700 This issue is affecting users of our web application in production. We would appreciate feedback on the planned resolution and timeline. 1803092 4 lprenji 2021-10-12 07:08:48 -0700 I can confirm and reproduce the bug. It is also affecting our customers. Feedback would be appreciate. 1803113 5 youennf 2021-10-12 07:58:53 -0700 There is a known regression in canvas capture streams that is being worked on. I am unclear though whether that bug is specific to canvas capture stream or also applies to camera and/or peer connection media streams. Can anybody of you clarify? 1803114 6 will.morgan 2021-10-12 08:00:09 -0700 Hi Youenn, our application makes use of getUserMedia and the video element. We don't use CanvasCaptureMediaStreamTrack et al, at all. Hopefully that clarifies? 1803119 7 lprenji 2021-10-12 08:14:27 -0700 In our case the we use peer connection media streams and add those to a srcObject to a videoElement. It displays nothing as in the webrtc sample. 1803128 8 youennf 2021-10-12 08:38:27 -0700 Thanks. Would you have repro cases? https://webrtc.github.io/samples/src/content/peerconnection/pc1/ should hopefully work fine. Or you can send privately to me sysdiagnoses (youenn@apple.com). 1804727 9 chris.mo 2021-10-15 00:53:59 -0700 Our application have same issue start from Safari Technology Preview 126 or above. 1807636 10 youennf 2021-10-22 04:55:24 -0700 https://webrtc.github.io/samples/src/content/capture/canvas-video/ has an issue with canvas capture so I do not think it is good to consider it for . Does any of you have a different repro case that I can use, not based on canvas capture? 1808706 11 Kongpheng.Nanthavongsa 2021-10-25 18:34:04 -0700 Youenn, using the sample repo you mentioned, it's possible to see video not auto-resume as expected. Granted this isn't the same as freezing, but just wanted to share, in case it was helpful: * Open https://webrtc.github.io/samples/src/content/peerconnection/pc1/ * Click Start button * Grant access to microphone and camera * Notice video is captured * Make a call to the iPhone * From Call UI dialog, decline it * Notice that video doesn't get auto-resumed, instead you see a black rectangle where video used to be This might be more similar to https://bugs.webkit.org/show_bug.cgi?id=231365 though. 1811973 12 csantos 2021-11-04 14:58:38 -0700 I'm able to reproduce using Youenn's sample repo. I added 'muted' property on the remote video. See it here https://charliesantos.github.io/samples/src/content/peerconnection/pc1/ Steps: 1. Load https://charliesantos.github.io/samples/src/content/peerconnection/pc1/ 2. Press start then call button, grant access to the mic/camera 3. Make sure the video is captured 4. Make a phone call to the iPhone. Have it ring for about 10-15 seconds 5. Swipe up the call notification to go back to the page 6. Press Hang Up button, or interact to the page. Notice that the whole page is frozen. 1812546 13 youennf 2021-11-08 00:30:09 -0800 @Charlie, the freeze should be fixed in latest iOS 15.2 beta. @Kongpheng, I think this is also the case in latest iOS 15.2 beta, can you validate and if not file another bug? @Alec, the issue with the tea pot is related to canvas capture and is being worked on. Latest Safari Tech Preview should be working. Please reopen if that is not the case. 1838069 14 yevhen.lv.developer 2022-02-07 04:47:56 -0800 Hi. iOS 15.2 has same problem. Using Webrtc without canvas, only simple video. Chrome, Safari, Firefox with started video call freezes after incoming call. Black screen instead video and page doesn't react on touches. Sometimes page reload helps, but usually I should close chrome and open it again. 1855034 15 ddp.bkdn 2022-03-25 00:48:28 -0700 For this black camera error, we can sometimes reproduce it on iOS 15.3 and 15.4 on my WebRTC product. Feedback would be appreciated. 1874114 16 ddp.bkdn 2022-06-04 02:36:22 -0700 Hi @youenn, We can confirm and reproduce this bug on iOS/iPadOS 15.4.1 Here are steps to reproduce: 1. Open the link using webRTC (https://it.dev-akameet.link/video/room/videocall) 2. Allow micro and camera. 3. Click the button to join the meeting. Expected: The local video is normal. Actual: The local video is black. Note: From step 2 to step 3 do with speed as fast as possible. When you can't repo it, close the safari, open it again, and repeat the steps above, because the frequency isn't 100%. 1874115 17 ddp.bkdn 2022-06-04 02:50:19 -0700 (In reply to PhungDuong from comment #16) > Hi @youenn, > > We can confirm and reproduce this bug on iOS/iPadOS 15.4.1 > Here are steps to reproduce: > 1. Open the link using webRTC > (https://it.dev-akameet.link/video/room/videocall) > 2. Allow micro and camera. > 3. Click the button to join the meeting. > Expected: The local video is normal. > Actual: The local video is black. > > Note: From step 2 to step 3 do with speed as fast as possible. When you > can't repo it, close the safari, open it again, and repeat the steps above, > because the frequency isn't 100%. Also can repo this on iOS/iPadOS 15.5 1959771 18 electroteque 2023-06-04 15:02:22 -0700 Confirming this an issue, I've implemented canvas fullscreen support for iPhone using MediaStream and getting autoplay working was difficult. Muted stops autoplaying or it freezes. I think even playsinline causes it to fail. I don't need it inline I need a second video going fullscreen anyway. https://github.com/danrossi/canvas-pip-fullscreen/blob/main/src/CanvasFullscreen.js#L26 1993362 19 908589510 2023-11-17 00:19:14 -0800 In iOS17.1.1 Safari will appear to autoplay but randomly go to full screen. In iOS17.2Beta3 it will automatically go to full screen black screen but won't play, when clicking on the picture-in-picture mode it can play normally https://github.com/jeeinn/video_srcObject/blob/834922287206273c2e9bcad85819de775d4b1088/index.html#L65-L67 ``` stream = canvas.captureStream(); video = document.getElementById('theVideo'); video.srcObject = stream; ```