Summary: | REGRESSION: jQuery test Suite fails on multiple tests | ||
---|---|---|---|
Product: | WebKit | Reporter: | Alexander Willner <alex> |
Component: | JavaScriptCore | Assignee: | Nobody <webkit-unassigned> |
Status: | CLOSED WORKSFORME | ||
Severity: | Normal | CC: | ap, zwarich |
Priority: | P1 | Keywords: | InRadar, Regression |
Version: | 528+ (Nightly build) | ||
Hardware: | Mac | ||
OS: | OS X 10.5 | ||
URL: | http://jquery.com/test/ |
Description
Alexander Willner
2008-06-09 02:44:28 PDT
In Safari 3.1.1, I'm seeing one test fail (64.1), and 3 failures in a local debug build of r34472 (101.4, 101.5, 16.10). (In reply to comment #1) > In Safari 3.1.1, I'm seeing one test fail (64.1), and 3 failures in a local > debug build of r34472 (101.4, 101.5, 16.10). Well, I've was confused why you've other results then me (OS X 10.5.3, PowerPC, no plugins enabled) - so started some tests. It seems that the jQuery Test Suit isn't deterministic (at least it often shows different results). Here we come: Safari (3.1.1/5525.20) * Run: 1 and 2 * Tests completed in ~269571 milliseconds. * 9 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, ) * Run: 3 * Tests completed in 221206 milliseconds. * 5 tests of 1159 failed. (64.1, 101.4|5, 106.10, 134.1) Safari (WebKit r34469) * Run: 0 (see initial posting) * 6 tests of 1159 failed. (101.4|5, 106.10, 113.5|6, 134.1) * Run: 1-3 * Tests completed in ~180258 milliseconds. * 4 tests of 1159 failed. (101.4|5, 106.10, 134.1) * Run: 4 * Tests completed in 361665 milliseconds. * 10 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, 134.1, 139.2|3) * Run: 5 * Tests completed in 213043 milliseconds. * 8 tests of 1161 failed. (101.4|5, 106.10, 113.5|6|7, 114.5, 134.1) Camino (Version 1.6.1 (1.8.1.14 2008051211)) * Best run (till every test succeeded) * Tests completed in 448219 milliseconds. * 0 tests of 1157 failed. Firefox (Gecko/2008053008 Firefox/3.0) * Best run (till every test succeeded) * Tests completed in 723878 milliseconds. * 0 tests of 1157 failed. And here with Safari 4 (Version/4.0dp1 Safari/526.11.2) * Run: 1 * Tests completed in 109576 milliseconds. * 0 tests of 1157 failed. * Run: 2 * Tests completed in 176862 milliseconds. * 4 tests of 1159 failed. (101.4|5, 106.10, 134.1) Since this problem occurs with Firefox, Safari and Opera I've opened a ticket at jQuery: http://dev.jquery.com/ticket/3062 With a local debug build, I saw these tests fail: 101.4, 101.5, 106.10 (i.e. the same as in comment 1, modulo a typo). According to a comment in <http://dev.jquery.com/ticket/3062>, failures in "ajax module" test are sort of expected, and do not necessarily indicate any problems. All tests have been passing for a while. I will close this, and a new bug can be made for any particular test failures if they occur in the future. (In reply to comment #8) > All tests have been passing for a while. I will close this, and a new bug can > be made for any particular test failures if they occur in the future. > For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146 still fails in 5 of 5 runs: "146. fx module: animate option (queue === false) (1, 0, 1)" Tests completed in 95714 milliseconds. 1 tests of 1270 failed. (In reply to comment #9) > For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146 > still fails in 5 of 5 runs: I can't reproduce this on Intel. Could you please file a new bug for this? (In reply to comment #10) > (In reply to comment #9) > > For me (latest build (r38240), PowerBook G4 (PowerPC), OS-X 10.5) test 146 > > still fails in 5 of 5 runs: > > I can't reproduce this on Intel. Could you please file a new bug for this? > Finally with the latest nightly build I cannot reproduce that error anymore. |