133511 2014-06-04 06:40:47 -0700 iOS 8 WebGL cannot pass video to texImage2d 2016-10-25 06:43:58 -0700 1 1 1 Unclassified WebKit WebGL 528+ (Nightly build) iPhone / iPad Other RESOLVED FIXED http://www.scirra.com/labs/bugs/webglvideo/ InRadar P2 Normal --- 134199 1 ashley achristensen achristensen alastair brendan commit-queue dfarler dino doyer.guyllaume eric.carlson glenn jer.noble mail moo_lj89 philipj richard.getinfo rik sergio simon.fraser vincent.ogloblinsky webkit-bug-importer oldest_to_newest 1013305 0 ashley 2014-06-04 06:40:47 -0700 Visit the URL http://www.scirra.com/labs/bugs/webglvideo/. It creates a simple spinning cube and plays a clip of "big buck bunny". The video is used as the cube's texture. The video is On desktop Chrome and Firefox it works fine. On IE11 it does not work since it also does not support video being passed to texImage2d, but it's possible to work around since it can render video to a canvas 2D context and then pass that 2D canvas to texImage2d. On Chrome for Android it works. Note the video does not start until the first touch event (the demo is coded to start the video in the first touchstart to work around the gesture requirement). On Safari iOS 8 beta on an iPhone 4S, after touching the display remains blank - the texture is not updated. However the audio from the video starts playing and the fullscreen video playback controls appear. These are unwanted for this demo and likely unwanted for most use cases of playing video within a WebGL context. I could not get the workaround of rendering via a canvas2d to work either, and playback controls still appeared. (FWIW it appears iOS 7 does not support passing video to canvas2d drawImage() at all, and that iOS 8 adds support for this, but in my experimenting I still did not get a canvas2d with video drawn on to it to upload to a texture either.) The most convenient solution is if video can be passed directly to texImage2d, and not have playback controls appear. 1013306 1 ashley 2014-06-04 06:46:01 -0700 Sorry, editing fail. Last line of first paragraph should read "the video is h.264 encoded in .mp4 container and sent by the server with the MIME type video/mp4", so it should be a supported video format on iOS. 1013322 2 dino 2014-06-04 09:08:55 -0700 Why isn't Radar picking this up? 1013323 3 dino 2014-06-04 09:09:21 -0700 dfarler, do you know why webkit-bug-importer is not importing? 1013594 4 ashley 2014-06-05 10:34:03 -0700 In addition to this, and somewhat related: currently playback controls still appear when the video element is not added to the DOM but instead passed to canvas2d's drawImage(). For the same reasons as this report it should work without forcing fullscreen controls to appear. 1013880 5 dino 2014-06-06 16:36:34 -0700 (In reply to comment #4) > In addition to this, and somewhat related: currently playback controls still appear when the video element is not added to the DOM but instead passed to canvas2d's drawImage(). For the same reasons as this report it should work without forcing fullscreen controls to appear. Can you explain this a bit more? You are seeing the controls render even if the video is not in the page? Where are the controls? 1013882 6 dino 2014-06-06 16:42:45 -0700 <rdar://problem/14754378> 1014493 7 achristensen 2014-06-10 13:20:07 -0700 It opens the video fullscreen as if it were playing an html5 video (making the page no longer visible), but the video is black. The video controls work and the audio plays, but I can't see if the video is being drawn to texture because the canvas is covered. 1014494 8 webkit-bug-importer 2014-06-10 13:20:18 -0700 <rdar://problem/17256389> 1015114 9 mail 2014-06-12 07:44:34 -0700 On iOS a 'SecurityError: DOM Exception 18' will be thrown when trying to upload a video via texImage2d or when using it in a canvas drawImage(). In both cases the problem seems to be here in the 'wouldTaintOrigin' function: https://trac.webkit.org/browser/trunk/Source/WebCore/html/canvas/CanvasRenderingContext.cpp#L70 It seems that either the 'video->hasSingleSecurityOrigin()' or the 'video->player()->didPassCORSAccessCheck()' check fails. Please fix this, iOS is the only missing platform here! 1016437 10 mail 2014-06-18 05:51:25 -0700 That limitation is unfortunately still there in iOS 8 beta 2 (Webkit/538.39.2, Safari/9537.53). 1016874 11 vincent.ogloblinsky 2014-06-20 00:45:49 -0700 Dean, Any news about for this bug ? Could you assign it ? Klaus give us good informations for investing it. Regards 1016953 12 achristensen 2014-06-20 10:31:51 -0700 The hasSingleSecurityOrigin check fails. The source of this problem is in MediaPlayerPrivateAVFoundationObjC.mm: #if PLATFORM(IOS) // FIXME: Implement for iOS in WebKit System Interface. static inline NSURL *wkAVAssetResolvedURL(AVAsset*) { return nil; } #endif 1017002 13 233445 achristensen 2014-06-20 13:19:02 -0700 Created attachment 233445 Patch 1017003 14 233445 jer.noble 2014-06-20 13:19:45 -0700 Comment on attachment 233445 Patch r=me 1017256 15 mail 2014-06-21 03:29:30 -0700 Thanks for the patches! Great to see progress here! In the meantime I have made an additional simple and very reduced example for testing this case here: http://krpano.com/ios/bugs/ios8-webgl-video/ This example also shows the iPhone-only problem with the 'video fullscreen'. 1017287 16 233445 commit-queue 2014-06-21 08:30:29 -0700 Comment on attachment 233445 Patch Rejecting attachment 233445 from commit-queue. Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.appspot.com', '--bot-id=webkit-cq-01', 'build', '--no-clean', '--no-update', '--build-style=release', '--port=mac']" exit_code: 2 cwd: /Volumes/Data/EWS/WebKit Last 500 characters of output: rce/WebKit/mac/WebView/WebTextCompletionController.mm -o /Volumes/Data/EWS/WebKit/WebKitBuild/WebKit.build/Release/WebKitLegacy.build/Objects-normal/x86_64/WebTextCompletionController.o ** BUILD FAILED ** The following build commands failed: CompileC /Volumes/Data/EWS/WebKit/WebKitBuild/WebKit.build/Release/WebKitLegacy.build/Objects-normal/x86_64/WebSystemInterface.o mac/WebCoreSupport/WebSystemInterface.mm normal x86_64 objective-c++ com.apple.compilers.llvm.clang.1_0.compiler (1 failure) Full output: http://webkit-queues.appspot.com/results/5835844803887104 1017317 17 eric.carlson 2014-06-21 12:24:58 -0700 (In reply to comment #15) > Thanks for the patches! > Great to see progress here! > > In the meantime I have made an additional simple and very reduced example for testing this case here: > > http://krpano.com/ios/bugs/ios8-webgl-video/ > > This example also shows the iPhone-only problem with the 'video fullscreen'. Please file a separate bug for any additional problems you find. 1017577 18 achristensen 2014-06-23 09:41:29 -0700 This compiles fine. http://trac.webkit.org/changeset/170295 1017598 19 commit-queue 2014-06-23 10:38:16 -0700 Re-opened since this is blocked by bug 134199 1017602 20 simon.fraser 2014-06-23 10:53:08 -0700 Followup build fixes in r170299 and r170300. This did not "compile fine". 1017960 21 ashley 2014-06-24 08:58:49 -0700 Possibly related: video playback in canvas2d drawImage() is also buggy. See https://bugs.webkit.org/show_bug.cgi?id=134251 1022467 22 ashley 2014-07-15 07:09:32 -0700 This is marked "resolved fixed", but is only partially fixed in iOS 8 beta 3: the unwanted fullscreen playback controls still appear. They can however be exited and the cube displays correctly, albeit with poor performance on an iPhone 4S (looks like 3-4 FPS). As the original comment noted, the fullscreen playback controls are likely unsuitable for most use cases of playing video in WebGL. Also, surely the performance can be improved? 1025430 23 mail 2014-07-29 03:08:53 -0700 That bug is only partially fixed, when using cross-domain (CORS) videos, this still fails. Here the new bug report: https://bugs.webkit.org/show_bug.cgi?id=135379 and here a test case: http://krpano.com/ios/bugs/ios8-webgl-video-cors/ 1111942 24 moo_lj89 2015-07-24 00:43:35 -0700 (In reply to comment #23) > That bug is only partially fixed, when using cross-domain (CORS) videos, > this still fails. > > Here the new bug report: > https://bugs.webkit.org/show_bug.cgi?id=135379 > > and here a test case: > http://krpano.com/ios/bugs/ios8-webgl-video-cors/ Hi~~How do you solve this problem. 1132138 25 richard.getinfo 2015-10-10 09:41:56 -0700 In iOS 9.0.2 (13A452) video textures works but video does not play using this demo. I get the first frame but repeated attempts to play() after touch event will not trigger video playback. Am I missing something new? 1132151 26 richard.getinfo 2015-10-10 11:24:13 -0700 (In reply to comment #25) > In iOS 9.0.2 (13A452) video textures works but video does not play using > this demo. I get the first frame but repeated attempts to play() after > touch event will not trigger video playback. Am I missing something new? OK. Caught again by the iOS click-to-play "feature". Problem solved. 233445 2014-06-20 13:19:02 -0700 2014-06-21 08:30:29 -0700 Patch bug-133511-20140620131845.patch text/plain 4125 achristensen SW5kZXg6IFNvdXJjZS9XZWJDb3JlL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBTb3VyY2UvV2Vi Q29yZS9DaGFuZ2VMb2cJKHJldmlzaW9uIDE3MDE5OCkKKysrIFNvdXJjZS9XZWJDb3JlL0NoYW5n ZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwzICsxLDE4IEBACisyMDE0LTA2LTIwICBBbGV4IENo cmlzdGVuc2VuICA8YWNocmlzdGVuc2VuQHdlYmtpdC5vcmc+CisKKyAgICAgICAgW2lPU10gRml4 IHZpZGVvIGluIFdlYkdMLgorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1 Zy5jZ2k/aWQ9MTMzNTExCisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisK KyAgICAgICAgKiBXZWJDb3JlLmV4cC5pbjoKKyAgICAgICAgKiBwbGF0Zm9ybS9ncmFwaGljcy9h dmZvdW5kYXRpb24vb2JqYy9NZWRpYVBsYXllclByaXZhdGVBVkZvdW5kYXRpb25PYmpDLm1tOgor ICAgICAgICAoV2ViQ29yZTo6TWVkaWFQbGF5ZXJQcml2YXRlQVZGb3VuZGF0aW9uT2JqQzo6aGFz U2luZ2xlU2VjdXJpdHlPcmlnaW4pOgorICAgICAgICAoV2ViQ29yZTo6d2tBVkFzc2V0UmVzb2x2 ZWRVUkwpOiBEZWxldGVkLgorICAgICAgICAqIHBsYXRmb3JtL21hYy9XZWJDb3JlU3lzdGVtSW50 ZXJmYWNlLmg6CisgICAgICAgICogcGxhdGZvcm0vbWFjL1dlYkNvcmVTeXN0ZW1JbnRlcmZhY2Uu bW06CisgICAgICAgIERlY2xhcmUgYW5kIHVzZSByZXNvbHZlZFVSTCBvbiBBVlVSTEFzc2V0IGlu c3RlYWQgb2YgdXNpbmcgd2tBVkFzc2V0UmVzb2x2ZWRVUkwgdGhyb3VnaCBXZWJLaXRTeXN0ZW1J bnRlcmZhY2UuCisKIDIwMTQtMDYtMTkgIFNpbW9uIEZyYXNlciAgPHNpbW9uLmZyYXNlckBhcHBs ZS5jb20+CiAKICAgICAgICAgW2lPUyBXZWJLaXQyXSBNYWtlIC13ZWJraXQtb3ZlcmZsb3ctc2Ny b2xsaW5nOnRvdWNoIHdvcmsgaW4gaWZyYW1lcyAoYnJlYWtzIE1TV29yZCBwcmV2aWV3cykKSW5k ZXg6IFNvdXJjZS9XZWJDb3JlL1dlYkNvcmUuZXhwLmluCj09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFNvdXJjZS9X ZWJDb3JlL1dlYkNvcmUuZXhwLmluCShyZXZpc2lvbiAxNzAwNzQpCisrKyBTb3VyY2UvV2ViQ29y ZS9XZWJDb3JlLmV4cC5pbgkod29ya2luZyBjb3B5KQpAQCAtMjMyNSw3ICsyMzI1LDYgQEAgX19a Tks3V2ViQ29yZTdJbnRTaXplY3Y2Q0dTaXplRXYKIF9fWk5LN1dlYkNvcmU4SW50UG9pbnRjdjhf TlNQb2ludEV2CiBfX1pOSzdXZWJDb3JlOUZsb2F0UmVjdGN2N19OU1JlY3RFdgogX3N0cmluZ0Vu Y29kaW5nRm9yUmVzb3VyY2UKLV93a0FWQXNzZXRSZXNvbHZlZFVSTAogX3drQWNjZXNzaWJpbGl0 eUhhbmRsZUZvY3VzQ2hhbmdlZAogX3drQWR2YW5jZURlZmF1bHRCdXR0b25QdWxzZUFuaW1hdGlv bgogX3drQ29weUFYVGV4dE1hcmtlclJhbmdlRW5kCkluZGV4OiBTb3VyY2UvV2ViQ29yZS9wbGF0 Zm9ybS9ncmFwaGljcy9hdmZvdW5kYXRpb24vb2JqYy9NZWRpYVBsYXllclByaXZhdGVBVkZvdW5k YXRpb25PYmpDLm1tCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFNvdXJjZS9XZWJDb3JlL3BsYXRmb3JtL2dyYXBo aWNzL2F2Zm91bmRhdGlvbi9vYmpjL01lZGlhUGxheWVyUHJpdmF0ZUFWRm91bmRhdGlvbk9iakMu bW0JKHJldmlzaW9uIDE3MDA3NCkKKysrIFNvdXJjZS9XZWJDb3JlL3BsYXRmb3JtL2dyYXBoaWNz L2F2Zm91bmRhdGlvbi9vYmpjL01lZGlhUGxheWVyUHJpdmF0ZUFWRm91bmRhdGlvbk9iakMubW0J KHdvcmtpbmcgY29weSkKQEAgLTEwMiw2ICsxMDIsMTAgQEAgQGludGVyZmFjZSBBVlBsYXllckl0 ZW0gKFdlYktpdEV4dGVuc2lvbgogQGVuZAogI2VuZGlmCiAKK0BpbnRlcmZhY2UgQVZVUkxBc3Nl dCAoV2ViS2l0RXh0ZW5zaW9ucykKK0Bwcm9wZXJ0eSAobm9uYXRvbWljLCByZWFkb25seSkgTlNV UkwgKnJlc29sdmVkVVJMOworQGVuZAorCiB0eXBlZGVmIEFWUGxheWVySXRlbSBBVlBsYXllckl0 ZW1UeXBlOwogdHlwZWRlZiBBVk1ldGFkYXRhSXRlbSBBVk1ldGFkYXRhSXRlbVR5cGU7CiAKQEAg LTE3MDEsMjEgKzE3MDUsMTMgQEAgdm9pZCBNZWRpYVBsYXllclByaXZhdGVBVkZvdW5kYXRpb25P YmpDOgogCiAgICAgc2V0TmF0dXJhbFNpemUocm91bmRlZEludFNpemUobV9jYWNoZWRQcmVzZW50 YXRpb25TaXplKSk7CiB9Ci0KLSNpZiBQTEFURk9STShJT1MpCi0vLyBGSVhNRTogSW1wbGVtZW50 IGZvciBpT1MgaW4gV2ViS2l0IFN5c3RlbSBJbnRlcmZhY2UuCi1zdGF0aWMgaW5saW5lIE5TVVJM ICp3a0FWQXNzZXRSZXNvbHZlZFVSTChBVkFzc2V0KikKLXsKLSAgICByZXR1cm4gbmlsOwotfQot I2VuZGlmCi0KKyAgICAKIGJvb2wgTWVkaWFQbGF5ZXJQcml2YXRlQVZGb3VuZGF0aW9uT2JqQzo6 aGFzU2luZ2xlU2VjdXJpdHlPcmlnaW4oKSBjb25zdCAKIHsKICAgICBpZiAoIW1fYXZBc3NldCkK ICAgICAgICAgcmV0dXJuIGZhbHNlOwogICAgIAotICAgIFJlZlB0cjxTZWN1cml0eU9yaWdpbj4g cmVzb2x2ZWRPcmlnaW4gPSBTZWN1cml0eU9yaWdpbjo6Y3JlYXRlKFVSTCh3a0FWQXNzZXRSZXNv bHZlZFVSTChtX2F2QXNzZXQuZ2V0KCkpKSk7CisgICAgUmVmUHRyPFNlY3VyaXR5T3JpZ2luPiBy ZXNvbHZlZE9yaWdpbiA9IFNlY3VyaXR5T3JpZ2luOjpjcmVhdGUoVVJMKFttX2F2QXNzZXQgcmVz b2x2ZWRVUkxdKSk7CiAgICAgUmVmUHRyPFNlY3VyaXR5T3JpZ2luPiByZXF1ZXN0ZWRPcmlnaW4g PSBTZWN1cml0eU9yaWdpbjo6Y3JlYXRlRnJvbVN0cmluZyhhc3NldFVSTCgpKTsKICAgICByZXR1 cm4gcmVzb2x2ZWRPcmlnaW4tPmlzU2FtZVNjaGVtZUhvc3RQb3J0KHJlcXVlc3RlZE9yaWdpbi5n ZXQoKSk7CiB9CkluZGV4OiBTb3VyY2UvV2ViQ29yZS9wbGF0Zm9ybS9tYWMvV2ViQ29yZVN5c3Rl bUludGVyZmFjZS5oCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFNvdXJjZS9XZWJDb3JlL3BsYXRmb3JtL21hYy9X ZWJDb3JlU3lzdGVtSW50ZXJmYWNlLmgJKHJldmlzaW9uIDE3MDA3NCkKKysrIFNvdXJjZS9XZWJD b3JlL3BsYXRmb3JtL21hYy9XZWJDb3JlU3lzdGVtSW50ZXJmYWNlLmgJKHdvcmtpbmcgY29weSkK QEAgLTI4OCw4ICsyODgsNiBAQCBleHRlcm4gYm9vbCAoKndrRXhlY3V0YWJsZVdhc0xpbmtlZE9u T3JCCiAKIGV4dGVybiBDRlN0cmluZ1JlZiAoKndrQ29weURlZmF1bHRTZWFyY2hQcm92aWRlckRp c3BsYXlOYW1lKSh2b2lkKTsKIAotZXh0ZXJuIE5TVVJMICooKndrQVZBc3NldFJlc29sdmVkVVJM KShBVkFzc2V0Kik7Ci0KIGV4dGVybiBOU0N1cnNvciAqKCp3a0N1cnNvcikoY29uc3QgY2hhciop OwogI2VuZGlmIC8vICFQTEFURk9STShJT1MpCiAgICAgCkluZGV4OiBTb3VyY2UvV2ViQ29yZS9w bGF0Zm9ybS9tYWMvV2ViQ29yZVN5c3RlbUludGVyZmFjZS5tbQo9PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBTb3Vy Y2UvV2ViQ29yZS9wbGF0Zm9ybS9tYWMvV2ViQ29yZVN5c3RlbUludGVyZmFjZS5tbQkocmV2aXNp b24gMTcwMDc0KQorKysgU291cmNlL1dlYkNvcmUvcGxhdGZvcm0vbWFjL1dlYkNvcmVTeXN0ZW1J bnRlcmZhY2UubW0JKHdvcmtpbmcgY29weSkKQEAgLTE0OCw4ICsxNDgsNiBAQCBib29sICgqd2tF eGVjdXRhYmxlV2FzTGlua2VkT25PckJlZm9yZVNuCiBDRlN0cmluZ1JlZiAoKndrQ29weURlZmF1 bHRTZWFyY2hQcm92aWRlckRpc3BsYXlOYW1lKSh2b2lkKTsKIHZvaWQgKCp3a1NldENyYXNoUmVw b3J0QXBwbGljYXRpb25TcGVjaWZpY0luZm9ybWF0aW9uKShDRlN0cmluZ1JlZik7CiAKLU5TVVJM ICooKndrQVZBc3NldFJlc29sdmVkVVJMKShBVkFzc2V0Kik7Ci0KIE5TQ3Vyc29yICooKndrQ3Vy c29yKShjb25zdCBjaGFyKik7CiAKIE5TQXJyYXkgKigqd2tTcGVlY2hTeW50aGVzaXNHZXRWb2lj ZUlkZW50aWZpZXJzKSh2b2lkKTsK