<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>115114</bug_id>
          
          <creation_ts>2013-04-24 09:36:10 -0700</creation_ts>
          <short_desc>ref-tests should compare the entire page instead of the viewport</short_desc>
          <delta_ts>2013-04-24 13:24:57 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>528+ (Nightly build)</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>NEW</bug_status>
          <resolution></resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P2</priority>
          <bug_severity>Normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Zoltan Horvath">zoltan</reporter>
          <assigned_to name="Nobody">webkit-unassigned</assigned_to>
          <cc>benjamin</cc>
    
    <cc>bjonesbe</cc>
    
    <cc>glenn</cc>
    
    <cc>jberlin</cc>
    
    <cc>rniwa</cc>
    
    <cc>simon.fraser</cc>
    
    <cc>thorton</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>880673</commentid>
    <comment_count>0</comment_count>
    <who name="Zoltan Horvath">zoltan</who>
    <bug_when>2013-04-24 09:36:10 -0700</bug_when>
    <thetext>The topic was discussed in https://lists.webkit.org/pipermail/webkit-dev/2013-April/024766.html</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>880763</commentid>
    <comment_count>1</comment_count>
    <who name="Glenn Adams">glenn</who>
    <bug_when>2013-04-24 12:51:45 -0700</bug_when>
    <thetext>if existing reftests assume that only a particular (e.g., 800x600) area is compared, then we should not change the default to compare the entire page; that is, comparing the entire page should be opt-in due to prior usage</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>880767</commentid>
    <comment_count>2</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2013-04-24 13:05:39 -0700</bug_when>
    <thetext>(In reply to comment #1)
&gt; if existing reftests assume that only a particular (e.g., 800x600) area is compared, then we should not change the default to compare the entire page; that is, comparing the entire page should be opt-in due to prior usage

We shouldn’t make such assumptions in reftests. If there are ref tests that make such a bad assumption, then we should fix them all.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>880771</commentid>
    <comment_count>3</comment_count>
    <who name="Glenn Adams">glenn</who>
    <bug_when>2013-04-24 13:24:57 -0700</bug_when>
    <thetext>(In reply to comment #2)
&gt; (In reply to comment #1)
&gt; &gt; if existing reftests assume that only a particular (e.g., 800x600) area is compared, then we should not change the default to compare the entire page; that is, comparing the entire page should be opt-in due to prior usage
&gt; 
&gt; We shouldn’t make such assumptions in reftests. If there are ref tests that make such a bad assumption, then we should fix them all.

ok, in that case, the documentations about creating reftests [1] should make this explicit; authors may have assumed that 800x600 holds due to the language in [2]

[1] http://trac.webkit.org/wiki/Writing%20Reftests
[2] http://trac.webkit.org/wiki/Writing%20Layout%20Tests%20for%20DumpRenderTree#Howtowriteportablepixeltests</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>