22962 2008-12-22 08:11:32 -0800 Web page encoded as "Big 5 HKSCS" is not decoded properly 2022-09-16 15:20:48 -0700 1 1 1 Unclassified WebKit Page Loading 528+ (Nightly build) Mac OS X 10.5 RESOLVED INVALID https://bugs.webkit.org/show_bug.cgi?id=160931 http://www.mingpaonews.com/20081222/gaa1h.htm HasReduction, InRadar P2 Normal --- 1 ddkilzer webkit-unassigned ap cdumez eric oldest_to_newest 103178 0 ddkilzer 2008-12-22 08:11:32 -0800 * SUMMARY Web page with "Big5" encoding specified in <meta> tag (and Content-Type sent as "text/html") is not detected as having "Big 5 HKSCS" encoding and is thus not decoded properly. The same page loaded in Firefox 3 is detected and decoded properly. * STEPS TO REPRODUCE 1. Launch Safari/WebKit. 2. Open URL: http://www.mingpaonews.com/20081222/gaa1h.htm * RESULTS Note square boxes in the text of the story, and how the text differs after switching to "Big 5 HKSCS" encoding via the "Text Encoding" item in the View menu. * REGRESSION Unknown. Tested Safari 3.2.1 on Mac OS X 10.5.6 and a local debug build of WebKit r39423. Both showed the same behavior. * NOTES Firefox 3 gets it right, so WebKit should be using a similar heuristic. 103180 1 ddkilzer 2008-12-22 08:19:56 -0800 <rdar://problem/6462924> 103184 2 ap 2008-12-22 08:50:50 -0800 This page uses an encoding that is different from either Big5 variant supported by Safari - note the replacement characters that appear after forcing the encoding to Big 5 HKSCS. 103186 3 ap 2008-12-22 08:54:45 -0800 Dave, do you know for a fact that Firefox decodes the text 100% correctly? Or just that it has no square boxes, question marks and other obvious brokenness? 103187 4 ddkilzer 2008-12-22 09:04:34 -0800 (In reply to comment #3) > Dave, do you know for a fact that Firefox decodes the text 100% correctly? Or > just that it has no square boxes, question marks and other obvious brokenness? Scrolling down the page, I see replacement characters in Firefox 3 as well. They're "?" characters without black diamonds around them. 103188 5 ddkilzer 2008-12-22 09:04:57 -0800 I wonder if MSIE 6/7/8 handle this page any better? 103189 6 ap 2008-12-22 09:11:26 -0800 (In reply to comment #4) > Scrolling down the page, I see replacement characters in Firefox 3 as well. > They're "?" characters without black diamonds around them. Are you sure about that? These looked like normal question marks to me. 103190 7 ddkilzer 2008-12-22 09:19:09 -0800 (In reply to comment #6) > (In reply to comment #4) > > Scrolling down the page, I see replacement characters in Firefox 3 as well. > > They're "?" characters without black diamonds around them. > > Are you sure about that? These looked like normal question marks to me. No, I am not sure. I do not read Chinese. :) I don't see any "square boxes" or question-marks-in-black-diamonds on the page in Firefox 3. I *do* see a character that looks like "No" with the "o" superscript and underlined (&#8470;) in the Firefox page that doesn't appear in the Safari page with "Big 5 HKSCS" encoding. Also note that the black diamonds in Desktop Safari when switching text encoding to "Big 5 HKSCS" are simply colons on the Firefox 3 page. Could this be a missing glyph or a decoding bug? 103191 8 ddkilzer 2008-12-22 09:21:01 -0800 The equivalent character from Desktop Safari (to the "No" character in Firefox 3): &#22050; 749931 9 eric 2012-10-24 12:44:03 -0700 It's unclear to me if this is still an issue. 1899098 10 gsnedders 2022-09-16 15:20:48 -0700 Archive.org doesn't seem to have archived this either, so it's not meaningfully actionable as I can tell.