Bug 223014

Summary: REGRESSION(r274076?): [ macOS wk2 ] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html is a flakey text failure
Product: WebKit Reporter: Robert Jenner <jenner>
Component: New BugsAssignee: Peng Liu <peng.liu6>
Status: NEW ---    
Severity: Normal CC: peng.liu6, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2021-03-09 18:55:47 PST 
imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html

is a flakey text failure in macOS wk2 in release and debug.

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fembedded-content%2Fmedia-elements%2Fmedia_fragment_seek.html

DIFF TEXT:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek-actual.txt
@@ -1,3 +1,3 @@
 
-PASS Video should seek to time specified in media fragment syntax
+FAIL Video should seek to time specified in media fragment syntax assert_equals: expected 3 but got 0
Comment 1 Radar WebKit Bug Importer 2021-03-09 18:56:05 PST 
<rdar://problem/75246097>
Comment 2 Robert Jenner 2021-03-09 19:00:39 PST 
Was able to reproduce the failure at tip of tree using the following test:

run-webkit-test imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html --iterations 100 -f
Comment 3 Robert Jenner 2021-03-10 10:51:46 PST 
Bisected down to a range of revisions where it started failing. Test does not fail when run on r274074, but does fail starting at r274078. 

Those two revisions were the only ones available to me in that range.
Comment 4 Robert Jenner 2021-03-10 11:03:17 PST 
It looks like changes at r274076 may have caused this test to crash, but I'm not certain. 

https://trac.webkit.org/changeset/274076/webkit
Comment 5 Robert Jenner 2021-03-10 11:13:54 PST 
(In reply to Robert Jenner from comment #4)
> It looks like changes at r274076 may have caused this test to crash, but I'm
> not certain. 
> 
> https://trac.webkit.org/changeset/274076/webkit

*Correction:
It looks like changes at r274076 may have caused this test to text fail, but I'm not certain.

https://trac.webkit.org/changeset/274076/webkit
Comment 6 Robert Jenner 2021-03-10 11:18:51 PST 
I have updated the test expectations here, while we wait to see if test can be fixed :

https://trac.webkit.org/changeset/274225/webkit