<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>66071</bug_id>
          
          <creation_ts>2011-08-11 10:03:06 -0700</creation_ts>
          <short_desc>Teach garden-o-matic about flaky tests</short_desc>
          <delta_ts>2011-10-17 13:17:49 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>528+ (Nightly build)</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>NEW</bug_status>
          <resolution></resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P2</priority>
          <bug_severity>Normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          <blocked>69227</blocked>
          <everconfirmed>1</everconfirmed>
          <reporter name="Dimitri Glazkov (Google)">dglazkov</reporter>
          <assigned_to name="Nobody">webkit-unassigned</assigned_to>
          <cc>abarth</cc>
    
    <cc>tony</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>449852</commentid>
    <comment_count>0</comment_count>
    <who name="Dimitri Glazkov (Google)">dglazkov</who>
    <bug_when>2011-08-11 10:03:06 -0700</bug_when>
    <thetext>We have all the information necessary to recognize flaky tests. We should use it to prompt the gardener to mark the test as flaky.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>457624</commentid>
    <comment_count>1</comment_count>
    <who name="Dimitri Glazkov (Google)">dglazkov</who>
    <bug_when>2011-08-26 10:38:58 -0700</bug_when>
    <thetext>The flakiness should be revealed in the &quot;Failing Tests&quot; view, so that you could have a choice to mark a test as either failing or flaky.

It might also be useful to show an item in the ui.notifications.TestsFailing &quot;causes&quot; list, indicating that a test is flaky -- and provide a &quot;Mark as Flaky&quot; button there, too.

An edge case where you have 400 tests failing, and 300 of them are also flaky, thus making &quot;causes&quot; list be extremely long seems unlikely.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>476688</commentid>
    <comment_count>2</comment_count>
    <who name="Adam Barth">abarth</who>
    <bug_when>2011-10-02 10:21:26 -0700</bug_when>
    <thetext>Punt to v2.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>485437</commentid>
    <comment_count>3</comment_count>
    <who name="Dimitri Glazkov (Google)">dglazkov</who>
    <bug_when>2011-10-17 13:17:49 -0700</bug_when>
    <thetext>avoid a trip to the flakiness dashboard

- is the test flaky?
- since when?</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>