Bug 18571 - Acid 3 doesn't always pass 100/100 tests
Summary: Acid 3 doesn't always pass 100/100 tests
Status: RESOLVED WORKSFORME
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: 528+ (Nightly build)
Hardware: Mac OS X 10.5
: P2 Normal
Assignee: Nobody
URL: http://acid3.acidtests.org/
Keywords:
Depends on:
Blocks:
 
Reported: 2008-04-17 22:55 PDT by Gavin Sherlock
Modified: 2011-01-23 15:20 PST (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Gavin Sherlock 2008-04-17 22:55:44 PDT
When running Acid3, I got only 98 passes, and it paused a long time on test 69.  Clicking on the "A" to find out the failures gave:

Failed 2 tests.
Test 26 passed, but took 41ms (less than 30fps)
Test 69 passed, but took 106 attempts (less than perfect).
Test 77 failed: expected '4776' but got '5550' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 passed, but took 2005ms (less than 30fps)
Total elapsed time: 10.16s

Reloading gave 100/100 many times, but then I got 99/100:

Failed 1 tests.
Test 26 passed, but took 41ms (less than 30fps)
Test 80 failed: kungFuDeathGrip was null
Total elapsed time: 0.47s

Occasionally, it would warn that scripting was needed to run the test, but would then proceed and pass all 100 anyway.

Tested with r32012 on 10.5.2
Comment 1 Daniele Metilli 2008-04-22 03:42:17 PDT
The 99/100 is due to bug 18144.
Comment 2 Andrew Muliar 2008-04-28 03:53:58 PDT
From first try:
Test 77 failed: expected '4776' butgot'5550'
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.

After relaunch Safari there is only: Test 80 failed: kungFuDeathGrip was null

After reloading page: 
Test 71 failed: Value undefined(result ofexpressiondoc.open) is not object
Test 72 failed: prerequisite failed: no image
Comment 3 Darren VanBuren 2008-04-30 16:53:29 PDT
With r32749, I just got:

Failed 1 of 100 tests.
Test 00 passed, but took 159ms (less than 30fps)
Test 26 passed, but took 57ms (less than 30fps)
Test 77 failed: expected '4776' but got '5550' - getComputedTextLength failed.
Test 79 passed, but took 118ms (less than 30fps)
Total elapsed time: 3.86s

Before I have gotten 78 and 80 not passing as well as 77.

I'm on 10.5.2 (No Graphics Update, Safari 3.0.4. I should update. I'll go do that.)
Comment 4 Patrick R. Gansterer 2011-01-23 15:20:00 PST
I don't think this is valid any more. Feel free to reopen the bug, if you don't agree.