Bug 221005

Summary: Incorrect sizing of uploaded images when using background-size:cover
Product: WebKit Reporter: Kenneth Kufluk <kenneth>
Component: ImagesAssignee: Cameron McCormack (:heycam) <heycam>
Status: RESOLVED FIXED    
Severity: Normal CC: akeerthi, eric.carlson, heycam, sabouhallawa, simon.fraser, smoley, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Safari 14   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Test image for upload
none
screenshot of the demo showing the erroneous white block
none
Testcase
none
Patch
none
Patch none

Kenneth Kufluk
Reported 2021-01-26 13:02:46 PST
Created attachment 418467 [details] Test image for upload On twitter.com the website, when uploading an image, you are able to hit 'edit' and zoom/crop the image. On iPhone when adding portrait images directly from camera, there is noticable flicker when later zooming the image. This can be reproduced on desktop safari (14 and STP) by airdropping the image to macbook. This seems to be a rendering error when sizing an image to certain dimensions. To reproduce in reduced case: Visit http://jsfiddle.net/r82facvo/7/ Run the code. Upload the attached image (floor.jpg) which was taken with iPhone 12 and converted to jpg on macbook. Observe that one of the divs showing the image has a large white block underneath.
Attachments
Test image for upload (4.74 MB, image/jpeg)
2021-01-26 13:02 PST, Kenneth Kufluk
no flags
screenshot of the demo showing the erroneous white block (384.32 KB, image/png)
2021-01-26 13:03 PST, Kenneth Kufluk
no flags
Testcase (4.74 MB, application/zip)
2021-01-27 20:36 PST, Simon Fraser (smfr)
no flags
Patch (6.09 KB, patch)
2021-05-03 21:41 PDT, Cameron McCormack (:heycam)
no flags
Patch (6.04 KB, patch)
2021-05-03 21:42 PDT, Cameron McCormack (:heycam)
no flags
Kenneth Kufluk
Comment 1 2021-01-26 13:03:38 PST
Created attachment 418468 [details] screenshot of the demo showing the erroneous white block
Smoley
Comment 2 2021-01-27 17:38:20 PST
Thanks for filing, is this jsfiddle still live? I can't seem to get it to load.
Kenneth Kufluk
Comment 3 2021-01-27 20:04:53 PST
Yes, it should still be live. If Glitch is easier, I've posted it to: https://legend-gusty-leptoceratops.glitch.me With the code available via the fish menu or at https://glitch.com/edit/#!/legend-gusty-leptoceratops
Radar WebKit Bug Importer
Comment 4 2021-01-27 20:08:39 PST
Simon Fraser (smfr)
Comment 5 2021-01-27 20:08:55 PST
This looks like a bug in a framework below webkit.
Kenneth Kufluk
Comment 6 2021-01-27 20:25:40 PST
Adding a border seems to help, eg .img { border: 1px solid transparent }
Simon Fraser (smfr)
Comment 7 2021-01-27 20:35:35 PST
I take that back. The floor.jpg image has an EXIF rotation, so we get to GraphicsContext::drawPlatformImage() and hit this branch: if (options.orientation() != ImageOrientation::None) { if (auto transform = options.orientation().transformFromDefault(imageSize).inverse()) subimageRect = transform.value().mapRect(subimageRect); } which is where I think things go wrong. We also hit the subsequent assertion: ASSERT(CGImageGetHeight(subImage.get()) == currHeight - CGRectIntegral(srcRect).origin.y); Attaching a standalone testcase.
Simon Fraser (smfr)
Comment 8 2021-01-27 20:36:01 PST
Created attachment 418610 [details] Testcase
Kenneth Kufluk
Comment 9 2021-01-27 20:38:58 PST
Ah, that explains why the photo needed to be from the camera rather than one that had been manipulated (and thus lost the exif rotation).
Cameron McCormack (:heycam)
Comment 10 2021-05-03 19:10:39 PDT
(In reply to Simon Fraser (smfr) from comment #7) > I take that back. The floor.jpg image has an EXIF rotation, so we get to > GraphicsContext::drawPlatformImage() and hit this branch: > > if (options.orientation() != ImageOrientation::None) { > if (auto transform = > options.orientation().transformFromDefault(imageSize).inverse()) > subimageRect = transform.value().mapRect(subimageRect); > } I think this part's right. > which is where I think things go wrong. We also hit the subsequent assertion: > ASSERT(CGImageGetHeight(subImage.get()) == currHeight - > CGRectIntegral(srcRect).origin.y); But this is wrong. We need to be getting the oriented height of the image, since currHeight and srcRect are in "logical" space, and subImage deals with unoriented coordinates. Same for the following line, which I think is causing the height to be wrongly adjusted.
Cameron McCormack (:heycam)
Comment 11 2021-05-03 21:41:13 PDT
Cameron McCormack (:heycam)
Comment 12 2021-05-03 21:42:36 PDT
EWS
Comment 13 2021-05-04 14:40:37 PDT
Committed r276984 (237310@main): <https://commits.webkit.org/237310@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 427635 [details].
Kenneth Kufluk
Comment 14 2021-05-04 15:59:12 PDT
Thanks for the investigation and fix! I'm really excited to try it out and see the effect. ❤️🙏
Note You need to log in before you can comment on or make changes to this bug.