Bug 124298 - Flaky Test: media/video-fast-seek.html
Summary: Flaky Test: media/video-fast-seek.html
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: WebKit Commit Bot
URL:
Keywords:
Depends on:
Blocks: 50856
  Show dependency treegraph
 
Reported: 2013-11-13 11:41 PST by WebKit Commit Bot
Modified: 2013-11-14 13:42 PST (History)
3 users (show)

See Also:


Attachments
Archive of layout-test-results from webkit-cq-02 (458.07 KB, application/zip)
2013-11-13 11:41 PST, WebKit Commit Bot
no flags Details
Patch (2.67 KB, patch)
2013-11-13 14:00 PST, Jer Noble
eric.carlson: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description WebKit Commit Bot 2013-11-13 11:41:39 PST
This is an automatically generated bug from the commit-queue.
media/video-fast-seek.html has been flaky on the commit-queue.

media/video-fast-seek.html was authored by jer.noble@apple.com.
http://trac.webkit.org/browser/trunk/LayoutTests/media/video-fast-seek.html

The commit-queue just saw media/video-fast-seek.html flake (text diff) while processing attachment 216820 [details] on bug 124292.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.8.4

The bots will update this with information from each new failure.

If you believe this bug to be fixed or invalid, feel free to close.  The bots will re-open if the flake re-occurs.

If you would like to track this test fix with another bug, please close this bug as a duplicate.  The bots will follow the duplicate chain when making future comments.
Comment 1 WebKit Commit Bot 2013-11-13 11:41:42 PST
Created attachment 216827 [details]
Archive of layout-test-results from webkit-cq-02
Comment 2 Jer Noble 2013-11-13 14:00:08 PST
Created attachment 216853 [details]
Patch
Comment 3 Eric Carlson 2013-11-13 14:25:25 PST
Comment on attachment 216853 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=216853&action=review

> LayoutTests/media/video-fast-seek.html:-30
> -            testExpected('video.currentTime', 2.5);

How about "testExpected('video.currentTime.toFixed(1)', 2.5)" instead?

> LayoutTests/media/video-fast-seek.html:-46
> -            testExpected('video.currentTime', 2.3);

Ditto.
Comment 4 Martin Hock 2013-11-14 13:29:37 PST
Comment on attachment 216853 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=216853&action=review

>> LayoutTests/media/video-fast-seek.html:-30
>> -            testExpected('video.currentTime', 2.5);
> 
> How about "testExpected('video.currentTime.toFixed(1)', 2.5)" instead?

I'm surprised we would see a failure in 2.5 as it is an exact sum of powers of two.

I like Eric's suggestion but can we instead do something like video.currentTime.toFixed(2), '2.50' just to make sure we're extra-close?

The 2.6 and 2.2 checks could also fail because we aren't guaranteed about rounding direction (typically rounding to the nearest representable number occurs which could be slightly bigger than what you expect).  Can you change them to be "within epsilon" as well?  For example:

testExpected('video.currentTime.toFixed(2)', 2.2, <=)
Comment 5 Jer Noble 2013-11-14 13:41:19 PST
(In reply to comment #4)
> (From update of attachment 216853 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=216853&action=review
> 
> >> LayoutTests/media/video-fast-seek.html:-30
> >> -            testExpected('video.currentTime', 2.5);
> > 
> > How about "testExpected('video.currentTime.toFixed(1)', 2.5)" instead?
> 
> I'm surprised we would see a failure in 2.5 as it is an exact sum of powers of two.

The problem is, as always, converting between foating point, to fixed point, and back.

> I like Eric's suggestion but can we instead do something like video.currentTime.toFixed(2), '2.50' just to make sure we're extra-close?

It's really not that important, which is why I removed that part in my first version of the patch.

> The 2.6 and 2.2 checks could also fail because we aren't guaranteed about rounding direction (typically rounding to the nearest representable number occurs which could be slightly bigger than what you expect).  Can you change them to be "within epsilon" as well?  For example:
> 
> testExpected('video.currentTime.toFixed(2)', 2.2, <=)

For Mac and Win ports, we'll always be much > than 2.6 and much < than 2.2, as the fastSeek() logic will go to the next and previous Sync frame, respectively.  For other ports who haven't adopted the fastSeek back end, they  might have rounding errors.
Comment 6 Jer Noble 2013-11-14 13:42:05 PST
Committed r159306: <http://trac.webkit.org/changeset/159306>