Bug 206226 – Flaky Test: media/track/track-in-band-metadata-display-order.html

• Status: REOPENED
• Component: Tools / Tests

[WebKit Commit Bot]

This is an automatically generated bug from the commit-queue.
media/track/track-in-band-metadata-display-order.html has been flaky on the commit-queue.

media/track/track-in-band-metadata-display-order.html was authored by [e-mail].
https://trac.webkit.org/browser/trunk/LayoutTests/media/track/track-in-band-metadata-display-order.html

The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387642 [details] on bug 206127.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.14.6

The bots will update this with information from each new failure.

If you believe this bug to be fixed or invalid, feel free to close.  The bots will re-open if the flake re-occurs.

If you would like to track this test fix with another bug, please close this bug as a duplicate.  The bots will follow the duplicate chain when making future comments.

[WebKit Commit Bot]

Created attachment 387645 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387791 [details] on bug 206288.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.14.6

[WebKit Commit Bot]

Created attachment 387799 [details]
Archive of layout-test-results from webkit-cq-03

[WebKit Commit Bot]

The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387653 [details] on bug 206230.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.14.6

[WebKit Commit Bot]

Created attachment 387826 [details]
Archive of layout-test-results from webkit-cq-02

[WebKit Commit Bot]

The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387817 [details] on bug 206305.
Bot: webkit-cq-02  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.14.6

[WebKit Commit Bot]

Created attachment 387850 [details]
Archive of layout-test-results from webkit-cq-02

[Alexey Proskuryakov]

This test sometimes times out in post-commit testing, but doesn't fail in the same way.

Given how frequent this is now on commit queue, we will almost certainly need to do something about it.

@@ -15,7 +15,7 @@
 RUN(metadataTrack.addCue(new DataCue(2.25, video.duration, "second data cue")))
 RUN(video.currentTime = 3)
 EVENT(seeked)
-EXPECTED (textTrackDisplayElement(video, "display", 0).textContent == 'I am later') OK
-EXPECTED (textTrackDisplayElement(video, "display", 1).textContent == 'I am earlier') OK
+No text track cue with display id '-webkit-media-text-track-display' is currently visible
+No text track cue with display id '-webkit-media-text-track-display' is currently visible
 END OF TEST

[Radar WebKit Bug Importer]

<rdar://problem/59278855>

[Ryan Haddad]

Moving this to resolved / config changed as we still don't see it on trunk bots and CQ hasn't commented for a month.

[WebKit Commit Bot]

The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 392734 [details] on bug 208691.
Bot: webkit-cq-03  Port: <class 'webkitpy.common.config.ports.MacPort'>  Platform: Mac OS X 10.14.6

[WebKit Commit Bot]

Created attachment 392824 [details]
Archive of layout-test-results from webkit-cq-03

[Ryan Haddad]

Apparently this is still happening on EWS bots (and only EWS bots)

https://ews-build.webkit.org/#/builders/32/builds/6084
https://ews-build.webkit.org/#/builders/32/builds/5993
https://ews-build.webkit.org/#/builders/32/builds/5971
https://ews-build.webkit.org/#/builders/32/builds/5969

Trunk result:
https://results.webkit.org/?suite=layout-tests&test=media%2Ftrack%2Ftrack-in-band-metadata-display-order.html

[Jason Lawrence]

I am able to reproduce this issue with r259132 on Mojave with the command below.
run-webkit-tests --debug -1 media/track/track-default-attribute.html media/track/track-in-band-metadata-display-order.html

[2/2] media/track/track-in-band-metadata-display-order.html failed unexpectedly (text diff)
Retrying 1 unexpected failure ...
Running 1 DumpRenderTree.
1 test ran as expected, 1 didn't:

Diff:
r259132-1585332831_857aab2737af/layout-test-results/media/track/track-in-band-metadata-display-order-actual.txt
@@ -15,7 +15,7 @@
 RUN(metadataTrack.addCue(new DataCue(2.25, video.duration, "second data cue")))
 RUN(video.currentTime = 3)
 EVENT(seeked)
-EXPECTED (textTrackDisplayElement(video, "display", 0).textContent == 'I am later') OK
-EXPECTED (textTrackDisplayElement(video, "display", 1).textContent == 'I am earlier') OK
+No text track cue with display id '-webkit-media-text-track-display' is currently visible
+No text track cue with display id '-webkit-media-text-track-display' is currently visible
 END OF TEST

[Jason Lawrence]

I also fails on Catalina with r259121 using the command below.
run-webkit-tests media/track/track-default-attribute.html media/track/track-in-band-metadata-display-order.html

[2/2] media/track/track-in-band-metadata-display-order.html failed unexpectedly (text diff)
Retrying 1 unexpected failure ...
Running 1 WebKitTestRunner.
1 test ran as expected, 1 didn't:

[Ryan Haddad]

Marked test as flaky in https://trac.webkit.org/changeset/259292/webkit

[Jason Lawrence]

This issue appears to be resolved. I have removed the expectations here: https://trac.webkit.org/changeset/261380/webkit