<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>4584</bug_id>
          
          <creation_ts>2005-08-22 04:31:51 -0700</creation_ts>
          <short_desc>run-webkit-tests should not print &quot;actual expected diffs&quot; when there are no diffs</short_desc>
          <delta_ts>2005-08-22 11:41:44 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>420+</version>
          <rep_platform>Mac</rep_platform>
          <op_sys>OS X 10.4</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P4</priority>
          <bug_severity>Normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Eric Seidel (no email)">eric</reporter>
          <assigned_to name="Dave Hyatt">hyatt</assigned_to>
          <cc>ben.lamonica</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>17114</commentid>
    <comment_count>0</comment_count>
    <who name="Eric Seidel (no email)">eric</who>
    <bug_when>2005-08-22 04:31:51 -0700</bug_when>
    <thetext>run-webkit-tests should not print &quot;actual expected diffs&quot; when there are no diffs

Sometimes when using the --pixel tests, there are failures only on the pixel side of things, which still 
causes the resulting failure to print &quot;actual expected diffs&quot; and link to the render dump, even though they 
are all empty.

Furthermore, run-webkit-tests could differentiate between a render tree dump failure and a pixel dump 
failure when printing the -&gt; failed messages (-&gt; failed (pixel) ) , and also could include the percentage 
difference after -&gt;failed (-&gt;failed (pixel: 15.5%), etc.)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>17126</commentid>
    <comment_count>1</comment_count>
      <attachid>3516</attachid>
    <who name="Tobias Lidskog">tobiaslidskog</who>
    <bug_when>2005-08-22 08:50:36 -0700</bug_when>
    <thetext>Created attachment 3516
don&apos;t print layout diffs unless necessary

This is a fix for the first part of this bug (run-webkit-tests should not print
&quot;actual expected diffs&quot; when there are no diffs)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>17128</commentid>
    <comment_count>2</comment_count>
    <who name="Tobias Lidskog">tobiaslidskog</who>
    <bug_when>2005-08-22 08:53:17 -0700</bug_when>
    <thetext>Forgot to mention that the patch also assures that all rows in the result tables have the same number of 
td-cells.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>17138</commentid>
    <comment_count>3</comment_count>
      <attachid>3516</attachid>
    <who name="Darin Adler">darin</who>
    <bug_when>2005-08-22 11:14:17 -0700</bug_when>
    <thetext>Comment on attachment 3516
don&apos;t print layout diffs unless necessary

Looks like this patch results in two extra cells when $pixelTests is 0. Should
fix that. Otherwise, seems great.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>17139</commentid>
    <comment_count>4</comment_count>
      <attachid>3519</attachid>
    <who name="Tobias Lidskog">tobiaslidskog</who>
    <bug_when>2005-08-22 11:24:44 -0700</bug_when>
    <thetext>Created attachment 3519
address darin&apos;s comments</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>17140</commentid>
    <comment_count>5</comment_count>
      <attachid>3519</attachid>
    <who name="Darin Adler">darin</who>
    <bug_when>2005-08-22 11:31:06 -0700</bug_when>
    <thetext>Comment on attachment 3519
address darin&apos;s comments

r=me</thetext>
  </long_desc>
      
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>3516</attachid>
            <date>2005-08-22 08:50:36 -0700</date>
            <delta_ts>2005-08-22 11:24:44 -0700</delta_ts>
            <desc>don&apos;t print layout diffs unless necessary</desc>
            <filename>run-webkit-tests.diff</filename>
            <type>text/plain</type>
            <size>2203</size>
            <attacher name="Tobias Lidskog">tobiaslidskog</attacher>
            
              <data encoding="base64">SW5kZXg6IHJ1bi13ZWJraXQtdGVzdHMKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQpSQ1MgZmlsZTogL2N2cy9yb290L1dl
YktpdFRvb2xzL1NjcmlwdHMvcnVuLXdlYmtpdC10ZXN0cyx2CnJldHJpZXZpbmcgcmV2aXNpb24g
MS4xNQpkaWZmIC1wIC11IC1yMS4xNSBydW4td2Via2l0LXRlc3RzCi0tLSBydW4td2Via2l0LXRl
c3RzCTIxIEF1ZyAyMDA1IDAwOjQ1OjA0IC0wMDAwCTEuMTUKKysrIHJ1bi13ZWJraXQtdGVzdHMJ
MjIgQXVnIDIwMDUgMTU6NDY6MzUgLTAwMDAKQEAgLTQ0MywxNCArNDQzLDE4IEBAIGlmICgkY291
bnRze21hdGNofSAmJiAkY291bnRze21hdGNofSA9PSAKICAgICAgICAgICAgICRiYXNlID1+IHMv
XC4oaHRtbHx4bWx8eGh0bWx8c3ZnKSQvLzsKICAgICAgICAgICAgIHByaW50IEhUTUwgIjx0cj5c
biI7CiAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5
LyR0ZXN0XCI+JGJhc2U8L2E+PC90ZD5cbiI7Ci0gICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+
PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5LyRiYXNlLWV4cGVjdGVkLnR4dFwiPmV4cGVjdGVkPC9h
PjwvdGQ+XG4iOwotICAgICAgICAgICAgcHJpbnQgSFRNTCAiPHRkPjxhIGhyZWY9XCIkYmFzZS1h
Y3R1YWwudHh0XCI+YWN0dWFsPC9hPjwvdGQ+XG4iOwotICAgICAgICAgICAgcHJpbnQgSFRNTCAi
PHRkPjxhIGhyZWY9XCIkYmFzZS1kaWZmcy50eHRcIj5kaWZmczwvYT48L3RkPlxuIjsKLSAgICAg
ICAgICAgIGlmICgkcGl4ZWxUZXN0cykgeworICAgICAgICAgICAgaWYgKC1zICIkdGVzdFJlc3Vs
dHNEaXJlY3RvcnkvJGJhc2UtZGlmZnMudHh0IikgeworICAgICAgICAgICAgICAgIHByaW50IEhU
TUwgIjx0ZD48YSBocmVmPVwiJHRlc3REaXJlY3RvcnkvJGJhc2UtZXhwZWN0ZWQudHh0XCI+ZXhw
ZWN0ZWQ8L2E+PC90ZD5cbiI7CisgICAgICAgICAgICAgICAgcHJpbnQgSFRNTCAiPHRkPjxhIGhy
ZWY9XCIkYmFzZS1hY3R1YWwudHh0XCI+YWN0dWFsPC9hPjwvdGQ+XG4iOworICAgICAgICAgICAg
ICAgIHByaW50IEhUTUwgIjx0ZD48YSBocmVmPVwiJGJhc2UtZGlmZnMudHh0XCI+ZGlmZnM8L2E+
PC90ZD5cbiI7CisgICAgICAgICAgICB9IGVsc2UgeworICAgICAgICAgICAgICAgIHByaW50IEhU
TUwgIjx0ZD48L3RkPjx0ZD48L3RkPjx0ZD48L3RkPlxuIjsKKyAgICAgICAgICAgIH0KKyAgICAg
ICAgICAgIGlmICgkcGl4ZWxUZXN0cyAmJiAkaW1hZ2VzUHJlc2VudHskYmFzZX0pIHsKICAgICAg
ICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5LyRiYXNl
LWV4cGVjdGVkLnBuZ1wiPmV4cGVjdGVkIGltYWdlPC9hPjwvdGQ+XG4iOwotICAgICAgICAgICAg
ICAgIGlmICgkaW1hZ2VzUHJlc2VudHskYmFzZX0pIHsKLSAgICAgICAgICAgICAgICAgICAgcHJp
bnQgSFRNTCAiPHRkPjxhIGhyZWY9XCIkYmFzZS1kaWZmcy5odG1sXCI+aW1hZ2UgZGlmZnM8L2E+
PC90ZD5cbiI7Ci0gICAgICAgICAgICAgICAgfQorICAgICAgICAgICAgICAgIHByaW50IEhUTUwg
Ijx0ZD48YSBocmVmPVwiJGJhc2UtZGlmZnMuaHRtbFwiPmltYWdlIGRpZmZzPC9hPjwvdGQ+XG4i
OworICAgICAgICAgICAgfSBlbHNlIHsKKyAgICAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+
PC90ZD48dGQ+PC90ZD5cbiI7CiAgICAgICAgICAgICB9CiAgICAgICAgICAgICBwcmludCBIVE1M
ICI8L3RyPlxuIjsKICAgICAgICAgfQpAQCAtNDgxLDYgKzQ4NSw4IEBAIGlmICgkY291bnRze21h
dGNofSAmJiAkY291bnRze21hdGNofSA9PSAKICAgICAgICAgICAgIHByaW50IEhUTUwgIjx0ZD48
YSBocmVmPVwiJHRlc3REaXJlY3RvcnkvJGJhc2UtZXhwZWN0ZWQudHh0XCI+cmVzdWx0czwvYT48
L3RkPlxuIjsKICAgICAgICAgICAgIGlmICgkcGl4ZWxUZXN0cykgewogICAgICAgICAgICAgICAg
IHByaW50IEhUTUwgIjx0ZD48YSBocmVmPVwiJHRlc3REaXJlY3RvcnkvJGJhc2UtZXhwZWN0ZWQu
cG5nXCI+aW1hZ2U8L2E+PC90ZD5cbiI7CisgICAgICAgICAgICB9IGVsc2UgeworICAgICAgICAg
ICAgICAgIHByaW50IEhUTUwgIjx0ZD48L3RkPlxuIjsKICAgICAgICAgICAgIH0KICAgICAgICAg
ICAgIHByaW50IEhUTUwgIjwvdHI+XG4iOwogICAgICAgICB9Cg==
</data>
<flag name="review"
          id="424"
          type_id="1"
          status="-"
          setter="darin"
    />
          </attachment>
          <attachment
              isobsolete="0"
              ispatch="1"
              isprivate="0"
          >
            <attachid>3519</attachid>
            <date>2005-08-22 11:24:44 -0700</date>
            <delta_ts>2005-08-22 11:31:06 -0700</delta_ts>
            <desc>address darin&apos;s comments</desc>
            <filename>run-webkit-tests.diff</filename>
            <type>text/plain</type>
            <size>1796</size>
            <attacher name="Tobias Lidskog">tobiaslidskog</attacher>
            
              <data encoding="base64">SW5kZXg6IHJ1bi13ZWJraXQtdGVzdHMKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQpSQ1MgZmlsZTogL2N2cy9yb290L1dl
YktpdFRvb2xzL1NjcmlwdHMvcnVuLXdlYmtpdC10ZXN0cyx2CnJldHJpZXZpbmcgcmV2aXNpb24g
MS4xNQpkaWZmIC1wIC11IC1yMS4xNSBydW4td2Via2l0LXRlc3RzCi0tLSBydW4td2Via2l0LXRl
c3RzCTIxIEF1ZyAyMDA1IDAwOjQ1OjA0IC0wMDAwCTEuMTUKKysrIHJ1bi13ZWJraXQtdGVzdHMJ
MjIgQXVnIDIwMDUgMTg6MjQ6NDYgLTAwMDAKQEAgLTQ0MywxNCArNDQzLDIwIEBAIGlmICgkY291
bnRze21hdGNofSAmJiAkY291bnRze21hdGNofSA9PSAKICAgICAgICAgICAgICRiYXNlID1+IHMv
XC4oaHRtbHx4bWx8eGh0bWx8c3ZnKSQvLzsKICAgICAgICAgICAgIHByaW50IEhUTUwgIjx0cj5c
biI7CiAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5
LyR0ZXN0XCI+JGJhc2U8L2E+PC90ZD5cbiI7Ci0gICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+
PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5LyRiYXNlLWV4cGVjdGVkLnR4dFwiPmV4cGVjdGVkPC9h
PjwvdGQ+XG4iOwotICAgICAgICAgICAgcHJpbnQgSFRNTCAiPHRkPjxhIGhyZWY9XCIkYmFzZS1h
Y3R1YWwudHh0XCI+YWN0dWFsPC9hPjwvdGQ+XG4iOwotICAgICAgICAgICAgcHJpbnQgSFRNTCAi
PHRkPjxhIGhyZWY9XCIkYmFzZS1kaWZmcy50eHRcIj5kaWZmczwvYT48L3RkPlxuIjsKKyAgICAg
ICAgICAgIGlmICgtcyAiJHRlc3RSZXN1bHRzRGlyZWN0b3J5LyRiYXNlLWRpZmZzLnR4dCIpIHsK
KyAgICAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5
LyRiYXNlLWV4cGVjdGVkLnR4dFwiPmV4cGVjdGVkPC9hPjwvdGQ+XG4iOworICAgICAgICAgICAg
ICAgIHByaW50IEhUTUwgIjx0ZD48YSBocmVmPVwiJGJhc2UtYWN0dWFsLnR4dFwiPmFjdHVhbDwv
YT48L3RkPlxuIjsKKyAgICAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiRi
YXNlLWRpZmZzLnR4dFwiPmRpZmZzPC9hPjwvdGQ+XG4iOworICAgICAgICAgICAgfSBlbHNlIHsK
KyAgICAgICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PC90ZD48dGQ+PC90ZD48dGQ+PC90ZD5c
biI7CisgICAgICAgICAgICB9CiAgICAgICAgICAgICBpZiAoJHBpeGVsVGVzdHMpIHsKLSAgICAg
ICAgICAgICAgICBwcmludCBIVE1MICI8dGQ+PGEgaHJlZj1cIiR0ZXN0RGlyZWN0b3J5LyRiYXNl
LWV4cGVjdGVkLnBuZ1wiPmV4cGVjdGVkIGltYWdlPC9hPjwvdGQ+XG4iOwogICAgICAgICAgICAg
ICAgIGlmICgkaW1hZ2VzUHJlc2VudHskYmFzZX0pIHsKKyAgICAgICAgICAgICAgICAgICAgcHJp
bnQgSFRNTCAiPHRkPjxhIGhyZWY9XCIkdGVzdERpcmVjdG9yeS8kYmFzZS1leHBlY3RlZC5wbmdc
Ij5leHBlY3RlZCBpbWFnZTwvYT48L3RkPlxuIjsKICAgICAgICAgICAgICAgICAgICAgcHJpbnQg
SFRNTCAiPHRkPjxhIGhyZWY9XCIkYmFzZS1kaWZmcy5odG1sXCI+aW1hZ2UgZGlmZnM8L2E+PC90
ZD5cbiI7Ci0gICAgICAgICAgICAgICAgfQorICAgICAgICAgICAgICAgIH0gZWxzZSB7CisgICAg
ICAgICAgICAgICAgICAgIHByaW50IEhUTUwgIjx0ZD48L3RkPjx0ZD48L3RkPlxuIjsKKyAgICAg
ICAgICAgICAgICB9ICAgICAgICAgICAgCiAgICAgICAgICAgICB9CiAgICAgICAgICAgICBwcmlu
dCBIVE1MICI8L3RyPlxuIjsKICAgICAgICAgfQo=
</data>
<flag name="review"
          id="425"
          type_id="1"
          status="+"
          setter="darin"
    />
          </attachment>
      

    </bug>

</bugzilla>