Bug 4584 - run-webkit-tests should not print "actual expected diffs" when there are no diffs
Summary: run-webkit-tests should not print "actual expected diffs" when there are no d...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 420+
Hardware: Mac OS X 10.4
: P4 Normal
Assignee: Dave Hyatt
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2005-08-22 04:31 PDT by Eric Seidel (no email)
Modified: 2005-08-22 11:41 PDT (History)
1 user (show)

See Also:


Attachments
don't print layout diffs unless necessary (2.15 KB, patch)
2005-08-22 08:50 PDT, Tobias Lidskog
darin: review-
Details | Formatted Diff | Diff
address darin's comments (1.75 KB, patch)
2005-08-22 11:24 PDT, Tobias Lidskog
darin: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Eric Seidel (no email) 2005-08-22 04:31:51 PDT
run-webkit-tests should not print "actual expected diffs" when there are no diffs

Sometimes when using the --pixel tests, there are failures only on the pixel side of things, which still 
causes the resulting failure to print "actual expected diffs" and link to the render dump, even though they 
are all empty.

Furthermore, run-webkit-tests could differentiate between a render tree dump failure and a pixel dump 
failure when printing the -> failed messages (-> failed (pixel) ) , and also could include the percentage 
difference after ->failed (->failed (pixel: 15.5%), etc.)
Comment 1 Tobias Lidskog 2005-08-22 08:50:36 PDT
Created attachment 3516 [details]
don't print layout diffs unless necessary

This is a fix for the first part of this bug (run-webkit-tests should not print
"actual expected diffs" when there are no diffs)
Comment 2 Tobias Lidskog 2005-08-22 08:53:17 PDT
Forgot to mention that the patch also assures that all rows in the result tables have the same number of 
td-cells.
Comment 3 Darin Adler 2005-08-22 11:14:17 PDT
Comment on attachment 3516 [details]
don't print layout diffs unless necessary

Looks like this patch results in two extra cells when $pixelTests is 0. Should
fix that. Otherwise, seems great.
Comment 4 Tobias Lidskog 2005-08-22 11:24:44 PDT
Created attachment 3519 [details]
address darin's comments
Comment 5 Darin Adler 2005-08-22 11:31:06 PDT
Comment on attachment 3519 [details]
address darin's comments

r=me