73519 2011-11-30 21:19:18 -0800 [Qt] QtWebKit does not apply correct encoding on some pages with CJK characters 2014-02-03 03:19:19 -0800 1 1 1 Unclassified WebKit WebKit Qt 528+ (Nightly build) PC Linux RESOLVED INVALID Qt P3 Normal --- 0 adawit webkit-unassigned ap moriramar sfcheng oldest_to_newest 512423 0 adawit 2011-11-30 21:19:18 -0800 The following bug was reported downstream against the kwebkitpart, but was validated to be an upstream issue using QtTestBrowser: https://bugs.kde.org/show_bug.cgi?id=287690 Summary: KWebkitPart does not apply correct locale encoding settings on some pages with CJK characters. Product: kwebkitpart Version: unspecified Platform: Gentoo Packages OS/Version: Linux Status: UNCONFIRMED Severity: normal Priority: NOR Component: general AssignedTo: webkit-devel@kde.org ReportedBy: moriramar@gmail.com Version: unspecified (using KDE 4.7.2) OS: Linux When I open some pages with both simplified Chinese characters and traditional Chinese characters, some characters are not displayed correctly. Pages containing both Chinese characters and Japanese characters might cause this problem as well. Personal guess: These pages might be encoded in zh_CN.GBK or zh_CN.GB18030 (which contains more character encodings), while KWebkitPart might apply zh_CN.GB2312 (which is generally considered as a subset of GBK). Reproducible: Always Steps to Reproduce: 1. Install a font covering CJK characters. Bitstream Cyberbit, WenQuanYi Zen Hei, WenQuanYi Microhei or Droid is OK. 2. Make sure zh_CN.GBK, zh_CN.GB2312, zh_CN.GB18030, zh_CN.UTF-8 locales are available on the system. 3. Open Konqueror 4.7.2 and enable Webkit mode. 4. Go to http://www.acfun.tv/v/ac265957/ , which might be a little slow. Actual Results: In the top bold title line of the page content, a black box with white question mark appears. In the next line, there are two black boxes seperated by a "W" character, followed by a "o" character. Trying "View >> Encoding >> Simplified Chinese >>" any GB* locales does not solve the problem. Opening this kind of pages has a chance to crash Konqueror. Expected Results: No these black boxes and "W" or "o" characters in these two line. KHTML can show this page well when encoding is set to "Simplified Chinese >> GBK" or "Simplified Chinese >> GB18030", which can be referred to. 512489 1 moriramar 2011-11-30 22:28:38 -0800 *** Bug 73447 has been marked as a duplicate of this bug. *** 531915 2 121609 sfcheng 2012-01-08 18:52:49 -0800 Created attachment 121609 test page 531916 3 sfcheng 2012-01-08 18:56:29 -0800 I can produce the same bug as well. The attachment above is a test page which contains both chinese simplified and chinese traditional characters. The chinese traditional characters show up as junk inside QtWebkit. The same page is displayed correctly inside IE and Webkit. (In reply to comment #2) > Created an attachment (id=121609) [details] > test page 975351 4 jturcotte 2014-02-03 03:19:19 -0800 === Bulk closing of Qt bugs === If you believe that this bug report is still relevant for a non-Qt port of webkit.org, please re-open it and remove [Qt] from the summary. If you believe that this is still an important QtWebKit bug, please fill a new report at https://bugreports.qt-project.org and add a link to this issue. See http://qt-project.org/wiki/ReportingBugsInQt for additional guidelines. 121609 2012-01-08 18:52:49 -0800 2012-01-08 18:52:49 -0800 test page gb2312_testpage.htm text/html 576 sfcheng PCFET0NUWVBFIEhUTUwgUFVCTElDICItLy9XM0MvL0RURCBIVE1MIDQuMCBUcmFuc2l0aW9uYWwv L0VOIj4NCjxIVE1MPjxIRUFEPjxUSVRMRT7DwNP9s/bB+dbWu/nS8rvsus+67yAtIM60w/u/1bzk KG1pdGJicy5jb20pIC0guqPN4ruqyMu12tK7w8W7pzwvVElUTEU+DQo8TUVUQSBjb250ZW50PSJ0 ZXh0L2h0bWw7IGNoYXJzZXQ9Z2IyMzEyIiBodHRwLWVxdWl2PUNvbnRlbnQtVHlwZT4NCjwvSEVB RD4NCjxCT0RZPg0KPHA+DQrDwLn6tu3A1bjUv8bRp7zS0PuyvKOszbi5/bvsus82uPa647rTuu+1 xLyr1OfG2sXfzKWjrMrXtM6zybmmxeDT/bP2M+tiobi7+dLyu+y6z6G5uu/X06Os09DN+86q0r3R p9HQvr+0+MC01ti08827xsaho9HQvr+xqLjmvavT2tfu0MLSu8bayKjN/sn6w/y/xtGnxtq/r6G2 z7iw+6G3v6+1x6Gjsru5/dPQ16i80rWj0MTR0L6/u/LOqtF90XXIy7+qwrejrNLg09C2r87vyKjS 5tfp1q/F+sbA08zI58Xa0XWhuL/G0ae51s7vobmjrNbK0sm/xtGnvefErsrTtq/O78io0uajrLWj 0MS7+dLyuMTU7LrzufvE0cHPo6y/ycTcwe7KtdHptq/O78rcv+ChozwvcD4NCjwvQk9EWT48L0hU TUw+IA0K