Bug 19445
Summary: | REGRESSION: jQuery test Suite fails on multiple tests | ||
---|---|---|---|
Product: | WebKit | Reporter: | Alexander Willner <alex> |
Component: | JavaScriptCore | Assignee: | Nobody <webkit-unassigned> |
Status: | CLOSED WORKSFORME | ||
Severity: | Normal | CC: | ap, zwarich |
Priority: | P1 | Keywords: | InRadar, Regression |
Version: | 528+ (Nightly build) | ||
Hardware: | Mac | ||
OS: | OS X 10.5 | ||
URL: | http://jquery.com/test/ |
Alexander Willner
First comment:
I'm sure this problem is known but I couldn't find a related bug searching for "jQuery".
Short description:
Using the latest Nightly Build (r34367) under OS X (10.5.3) the linked jQuery Test Suits fails at the following tests (test.subtest):
* 101.4
* 101.5
* 106.10
* 113.5
* 113.6
* 134.1
Got: "6 tests of 1159 failed."
Should be: "0 tests of 1159 failed."
Second comment:
With Safari 3.1 the same and some further tests fail too. Theses tests are fine with Mozilla Firefox 3.0 (Gecko/2008053008) - here the tests 139.2 and 139.3 is the only one that fail.
Attachments | ||
---|---|---|
Add attachment proposed patch, testcase, etc. |
Alexey Proskuryakov
In Safari 3.1.1, I'm seeing one test fail (64.1), and 3 failures in a local debug build of r34472 (101.4, 101.5, 16.10).
Alexey Proskuryakov
<rdar://problem/5996602>
Alexander Willner
(In reply to comment #1)
> In Safari 3.1.1, I'm seeing one test fail (64.1), and 3 failures in a local
> debug build of r34472 (101.4, 101.5, 16.10).
Well, I've was confused why you've other results then me (OS X 10.5.3, PowerPC, no plugins enabled) - so started some tests. It seems that the jQuery Test Suit isn't deterministic (at least it often shows different results). Here we come:
Safari (3.1.1/5525.20)
* Run: 1 and 2
* Tests completed in ~269571 milliseconds.
* 9 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, )
* Run: 3
* Tests completed in 221206 milliseconds.
* 5 tests of 1159 failed. (64.1, 101.4|5, 106.10, 134.1)
Safari (WebKit r34469)
* Run: 0 (see initial posting)
* 6 tests of 1159 failed. (101.4|5, 106.10, 113.5|6, 134.1)
* Run: 1-3
* Tests completed in ~180258 milliseconds.
* 4 tests of 1159 failed. (101.4|5, 106.10, 134.1)
* Run: 4
* Tests completed in 361665 milliseconds.
* 10 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, 134.1, 139.2|3)
* Run: 5
* Tests completed in 213043 milliseconds.
* 8 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, 134.1)
Camino (Version 1.6.1 (1.8.1.14 2008051211))
* Best run (till every test succeeded)
* Tests completed in 448219 milliseconds.
* 0 tests of 1157 failed.
Firefox (Gecko/2008053008 Firefox/3.0)
* Best run (till every test succeeded)
* Tests completed in 723878 milliseconds.
* 0 tests of 1157 failed.
Alexander Willner
And here with Safari 4 (Version/4.0dp1 Safari/526.11.2)
* Run: 1
* Tests completed in 109576 milliseconds.
* 0 tests of 1157 failed.
* Run: 2
* Tests completed in 176862 milliseconds.
* 4 tests of 1159 failed. (101.4|5, 106.10, 134.1)
Alexander Willner
Since this problem occurs with Firefox, Safari and Opera I've opened a ticket at jQuery: http://dev.jquery.com/ticket/3062
Cameron Zwarich (cpst)
All tests pass for me with the r34824 nightly and a local debug build of r34870. Can we close this?
Alexey Proskuryakov
With a local debug build, I saw these tests fail: 101.4, 101.5, 106.10 (i.e. the same as in comment 1, modulo a typo). According to a comment in <http://dev.jquery.com/ticket/3062>, failures in "ajax module" test are sort of expected, and do not necessarily indicate any problems.
Cameron Zwarich (cpst)
All tests have been passing for a while. I will close this, and a new bug can be made for any particular test failures if they occur in the future.
Alexander Willner
(In reply to comment #8)
> All tests have been passing for a while. I will close this, and a new bug can
> be made for any particular test failures if they occur in the future.
>
For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146 still fails in 5 of 5 runs:
"146. fx module: animate option (queue === false) (1, 0, 1)"
Tests completed in 95714 milliseconds.
1 tests of 1270 failed.
Alexey Proskuryakov
(In reply to comment #9)
> For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146
> still fails in 5 of 5 runs:
I can't reproduce this on Intel. Could you please file a new bug for this?
Alexander Willner
(In reply to comment #10)
> (In reply to comment #9)
> > For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146
> > still fails in 5 of 5 runs:
>
> I can't reproduce this on Intel. Could you please file a new bug for this?
>
Finally with the latest nightly build I cannot reproduce that error anymore.