85629 2012-05-04 08:40:16 -0700 [Qt] REGRESSION: 7 tests started to fail with newer Qt5 2014-02-01 19:00:14 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) All All RESOLVED INVALID Qt, QtTriaged P1 Critical --- 79666 79668 1 ossy webkit-unassigned hausmann menard ossy oldest_to_newest 616259 0 ossy 2012-05-04 08:40:16 -0700 After this update 10 tests started to fail with Qt5-WK2: https://lists.webkit.org/pipermail/webkit-qt/2012-May/002715.html fast/encoding/char-decoding.html fast/encoding/percent-escaping.html fast/loader/data-url-encoding-html.html fast/loader/data-url-encoding-svg.html http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode2.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode5.html http/tests/security/xssAuditor/script-tag-with-fancy-unicode.html http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding.html --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/char-decoding-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/char-decoding-actual.txt @@ -3,7 +3,7 @@ On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". -PASS decode('UTF-8', '%E2%88%9A') is 'U+221A' +FAIL decode('UTF-8', '%E2%88%9A') should be U+221A. Was U+003F. PASS decode('gb2312', '%A3%A0') is 'U+3000' PASS decode('gb_2312-80', '%A3%A0') is 'U+3000' PASS decode('chinese', '%A3%A0') is 'U+3000' --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/percent-escaping-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/percent-escaping-actual.txt @@ -1,3 +1,2 @@ -Test for bug 6452 - KURL::appendEscapingBadChars() should never escape percent characters. +FAIL: Timed out waiting for notifyDone to be called -SUCCESS --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/loader/data-url-encoding-html-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/loader/data-url-encoding-html-actual.txt @@ -1,6 +1,6 @@ Test that non-ASCII data: URLs are handled correctly. -1. SUCCESS. -2. SUCCESS. -3. SUCCESS. +1. FAILURE. +2. FAILURE. +3. FAILURE. --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/loader/data-url-encoding-svg-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/loader/data-url-encoding-svg-actual.txt @@ -1,6 +1,6 @@ Test that non-ASCII data: URLs are handled correctly. -1. SUCCESS. -2. SUCCESS. -3. SUCCESS. +1. FAILURE: ????????. +2. FAILURE: ????????. +3. FAILURE: ????????. --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode2-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode2-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode5-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-16bit-unicode5-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-fancy-unicode-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-fancy-unicode-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding-actual.txt @@ -1,3 +1,1 @@ -CONSOLE MESSAGE: Refused to execute a JavaScript script. Source code of script found within request. - 616260 1 ossy 2012-05-04 08:43:22 -0700 I skipped them - http://trac.webkit.org/changeset/116106 Please unskip with the proper fix. 616278 2 ossy 2012-05-04 09:11:45 -0700 It isn't Qt5-WK2 specific, but Qt5 specific. Skiplist will be fixed. 616281 3 ossy 2012-05-04 09:16:48 -0700 Skiplist fix landed in http://trac.webkit.org/changeset/116108 619586 4 menard 2012-05-09 09:44:22 -0700 Tracked in Qt by : https://codereview.qt-project.org/#change,25778 619783 5 menard 2012-05-09 13:27:41 -0700 (In reply to comment #4) > Tracked in Qt by : > > https://codereview.qt-project.org/#change,25778 Landed in Qt master. All these tests should be unskipped when we update to newer Qt. 626476 6 ossy 2012-05-17 05:20:08 -0700 (In reply to comment #5) > (In reply to comment #4) > > Tracked in Qt by : > > > > https://codereview.qt-project.org/#change,25778 > > Landed in Qt master. All these tests should be unskipped when we update to newer Qt. It fixed only these tests: fast/encoding/char-decoding.html fast/loader/data-url-encoding-html.html fast/loader/data-url-encoding-svg.html But the following tests still fail: fast/encoding/percent-escaping.html http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode2.html http/tests/security/xssAuditor/script-tag-with-16bit-unicode5.html http/tests/security/xssAuditor/script-tag-with-fancy-unicode.html http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding.html 626527 7 menard 2012-05-17 06:47:27 -0700 (In reply to comment #6) > (In reply to comment #5) > > (In reply to comment #4) > > > Tracked in Qt by : > > > > > > https://codereview.qt-project.org/#change,25778 > > > > Landed in Qt master. All these tests should be unskipped when we update to newer Qt. > > It fixed only these tests: > fast/encoding/char-decoding.html > fast/loader/data-url-encoding-html.html > fast/loader/data-url-encoding-svg.html > > But the following tests still fail: > fast/encoding/percent-escaping.html > http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode.html > http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair.html > http/tests/security/xssAuditor/script-tag-with-16bit-unicode2.html > http/tests/security/xssAuditor/script-tag-with-16bit-unicode5.html > http/tests/security/xssAuditor/script-tag-with-fancy-unicode.html > http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding.html darktears@DarthVader:~/dev/troll/webkit$ WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt -2 --release --iterations 100 LayoutTests/http/tests/security/xssAuditor Running new-run-webkit-tests with one child process. For more parallelism, run new-run-webkit-tests directly. All 16200 tests ran as expected. WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt 388.65s user 74.10s system 97% cpu 7:55.44 total darktears@DarthVader:~/dev/troll/webkit$ WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt --release --iterations 100 LayoutTests/http/tests/security/xssAuditor Running new-run-webkit-tests with one child process. For more parallelism, run new-run-webkit-tests directly. TAll 16200 tests ran as expected. WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt 136.87s user 10.16s system 36% cpu 6:37.74 total 626533 8 menard 2012-05-17 06:52:25 -0700 (In reply to comment #7) > (In reply to comment #6) > > (In reply to comment #5) > > > (In reply to comment #4) > > > > Tracked in Qt by : > > > > > > > > https://codereview.qt-project.org/#change,25778 > > > > > > Landed in Qt master. All these tests should be unskipped when we update to newer Qt. > > > > It fixed only these tests: > > fast/encoding/char-decoding.html > > fast/loader/data-url-encoding-html.html > > fast/loader/data-url-encoding-svg.html > > > > But the following tests still fail: > > fast/encoding/percent-escaping.html > > http/tests/security/xssAuditor/script-tag-Big5-char-twice-url-encode-16bit-unicode.html > > http/tests/security/xssAuditor/script-tag-with-16bit-unicode-surrogate-pair.html > > http/tests/security/xssAuditor/script-tag-with-16bit-unicode2.html > > http/tests/security/xssAuditor/script-tag-with-16bit-unicode5.html > > http/tests/security/xssAuditor/script-tag-with-fancy-unicode.html > > http/tests/security/xssAuditor/script-tag-with-invalid-url-encoding.html > > darktears@DarthVader:~/dev/troll/webkit$ WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt -2 --release --iterations 100 LayoutTests/http/tests/security/xssAuditor > Running new-run-webkit-tests with one child process. > For more parallelism, run new-run-webkit-tests directly. > All 16200 tests ran as expected. > > WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt 388.65s user 74.10s system 97% cpu 7:55.44 total > darktears@DarthVader:~/dev/troll/webkit$ WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt --release --iterations 100 LayoutTests/http/tests/security/xssAuditor > Running new-run-webkit-tests with one child process. > For more parallelism, run new-run-webkit-tests directly. > TAll 16200 tests ran as expected. > > WEBKITOUTPUTDIR=/home/darktears/dev/troll/webkit2-trunk run-webkit-tests --qt 136.87s user 10.16s system 36% cpu 6:37.74 total fast/encoding/percent-escaping.html is also passing 626548 9 ossy 2012-05-17 07:22:37 -0700 I still get failing tests on Ubuntu 11.10 and on Debian Squeeze ... ( I bet you tried them on your Arch or on Mac. :) ) 737531 10 ossy 2012-10-09 01:32:38 -0700 The bug is still valid now. 772794 11 ossy 2012-11-21 04:28:46 -0800 3 tests pass now: - fast/encoding/char-decoding.html - fast/loader/data-url-encoding-html.html - fast/loader/data-url-encoding-svg.html but the remaining 7 tests still fail with the same diff 772796 12 ossy 2012-11-21 04:31:10 -0800 adding 79668, because one test fails with timeout, not a simple fail: --- /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/percent-escaping-expected.txt +++ /ramdisk/qt-linux-32-release-webkit2/build/layout-test-results/fast/encoding/percent-escaping-actual.txt @@ -1,3 +1,2 @@ -Test for bug 6452 - KURL::appendEscapingBadChars() should never escape percent characters. +FAIL: Timed out waiting for notifyDone to be called -SUCCESS 772797 13 ossy 2012-11-21 04:31:31 -0800 I unskipped the 3 passing test - r135385.