NEW 231555
Internals.grabNextMediaStreamTrackFrame doesn't always convert to RGBA 
https://bugs.webkit.org/show_bug.cgi?id=231555
Summary Internals.grabNextMediaStreamTrackFrame doesn't always convert to RGBA
Cameron McCormack (:heycam)
Reported 2021-10-11 21:34:51 PDT
I tried using Internals.grabNextMediaStreamTrackFrame for a test. It relies on MediaSample::getRGBAImageData. MediaSampleAVFObjC::getRGBAImageData does try to convert the sample's underlying CVPixelBuffer to RGBA, but it doesn't seem to work, at least for the case I was trying. When the frame was using a YUV420 pixel format, the PixelBufferConformerCV failed to do a conversion and instead produced a new CVPixelBuffer with the same format. The result is that in the test, the ImageData object passed to the grabNextMediaStreamTrackFrame Promise callback contained planar YUV data pretending to be RGBA. I failed to trace into VTPixelBufferConformerCopyConformedPixelBuffer to work out why this wasn't working.
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2021-10-18 21:35:20 PDT
<rdar://problem/84400615>
Note You need to log in before you can comment on or make changes to this bug.