Bug 221965 - REGRESSION (r272842): [ BigSur Wk2 ] imported/w3c/web-platform-tests/media-source/mediasource-seekable.html is a flakey text failure
Summary: REGRESSION (r272842): [ BigSur Wk2 ] imported/w3c/web-platform-tests/media-so...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Peng Liu
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-02-16 08:57 PST by Robert Jenner
Modified: 2021-03-18 11:48 PDT (History)
5 users (show)

See Also:


Attachments
Patch (1.69 KB, patch)
2021-02-16 09:18 PST, Robert Jenner
no flags Details | Formatted Diff | Diff
Patch (2.34 KB, patch)
2021-02-16 09:47 PST, Robert Jenner
no flags Details | Formatted Diff | Diff
Patch (1.43 KB, patch)
2021-02-17 14:33 PST, Robert Jenner
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-02-16 08:57:55 PST
imported/w3c/web-platform-tests/media-source/mediasource-seekable.html 

is a flakey text failure in BigSur release and debug in Wk 2.

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-seekable.html

DIFF URL:
https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r272904%20(227)/imported/w3c/web-platform-tests/media-source/mediasource-seekable-pretty-diff.html

TEXT DIFF:
 PASS Get seekable time ranges when the sourcebuffer is empty.
-PASS Get seekable time ranges after init segment received.
+FAIL Get seekable time ranges after init segment received. assert_equals: expected 6.549 but got NaN
 PASS Get seekable time ranges on an infinite stream.
Comment 1 Radar WebKit Bug Importer 2021-02-16 08:58:15 PST
<rdar://problem/74393187>
Comment 2 Robert Jenner 2021-02-16 09:09:07 PST
Failure reproducible with the same reported failure result at tip of tree using the test: 

run-webkit-test imported/w3c/web-platform-tests/media-source/mediasource-seekable.html --iterations 1000 -f

Failures appear to have started with r272842.

CHANGESET URL:
https://trac.webkit.org/changeset/272842/webkit
Comment 3 Robert Jenner 2021-02-16 09:18:29 PST
Created attachment 420475 [details]
Patch
Comment 4 Robert Jenner 2021-02-16 09:47:52 PST
Created attachment 420481 [details]
Patch
Comment 5 Robert Jenner 2021-02-16 11:52:23 PST
Discovered more tests that started flakey crashing at r272842:
• http/tests/navigation/parsed-iframe-dynamic-form-back-entry.html
• imported/w3c/web-platform-tests/html/canvas/element/imagebitmap/createImageBitmap-origin.sub.html 
• imported/w3c/web-platform-tests/intersection-observer/text-target.html
• imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/event_playing.html


HISTORY URL:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fembedded-content%2Fmedia-elements%2Fevent_playing.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fintersection-observer%2Ftext-target.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fembedded-content%2Fmedia-elements%2Fevent_canplaythrough.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fimagebitmap%2FcreateImageBitmap-origin.sub.html&platform=mac
Comment 6 Ryan Haddad 2021-02-17 10:44:50 PST
Comment on attachment 420481 [details]
Patch

Too many changelogs.
Comment 7 Robert Jenner 2021-02-17 14:33:25 PST
Created attachment 420718 [details]
Patch
Comment 8 Truitt Savell 2021-02-17 14:38:31 PST
Comment on attachment 420718 [details]
Patch

Clearing flags on attachment: 420718

Committed r273031 (234232@main): <https://commits.webkit.org/234232@main>
Comment 9 Peng Liu 2021-03-18 11:15:26 PDT
I think r274591 has fixed the flakiness.
Comment 10 Peng Liu 2021-03-18 11:48:34 PDT
TestExpectations was updated in r274649.