Bug 213146

Summary: REGRESSION: (r262904): [ Mac wk1 Debug ] media/remoteplayback-target-availability.html is flaky failing.
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: MediaAssignee: Nobody <webkit-unassigned>
Status: RESOLVED FIXED    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Mac   
OS: macOS 10.14   
See Also: https://bugs.webkit.org/show_bug.cgi?id=213063

Jason Lawrence
Reported 2020-06-12 13:54:22 PDT
media/remoteplayback-target-availability.html Description: This test is flaky failing on Mac wk1 Debug. The first failure appears in the visual history on 6/11/2020. History: https://results.webkit.org/?suite=layout-tests&test=media%2Fremoteplayback-target-availability.html&flavor=wk1&platform=mac&style=debug Diff: --- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-expected.txt +++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-actual.txt @@ -3,7 +3,7 @@ ** test initial callback when device is unavailable -CALLBACK( available=false ) +CALLBACK( available=true ) ** simulate device becoming available CALLBACK( available=true )
Attachments
Note You need to log in before you can comment on or make changes to this bug.
Radar WebKit Bug Importer
Comment 1 2020-06-12 13:55:05 PDT
Jason Lawrence
Comment 2 2020-06-12 14:03:41 PDT
I have marked this test as flaky failing while this issue is investigated. https://trac.webkit.org/changeset/262976/webkit
Jason Lawrence
Comment 3 2020-06-12 14:37:14 PDT
I can reproduce this issue on r262972 and r262904, but I can't reproduce it on r262903. Command: Run-webkit-tests --debug --iterations 21 --exit-after-n-failures 3 --force -f -1 media/remoteplayback-prompt.html media/remoteplayback-target-availability.html r262904 results: [25/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff) [29/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff) [33/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff) Exiting early after 3 failures. 28 tests run. 25 tests ran as expected, 3 didn't (14 didn't run): Regressions: Unexpected text-only failures (1) media/remoteplayback-target-availability.html [ Failure ] r262903 results: All 42 tests ran as expected.
Jason Lawrence
Comment 4 2020-06-12 15:00:50 PDT
Reverted r262904 for reason: This commit broke a test on Mac wk1 Debug. Committed r262977: <https://trac.webkit.org/changeset/262977>
Alexey Proskuryakov
Comment 5 2020-06-14 19:52:12 PDT
The issue is fixed with a revert, but the test expectation still needs to be removed.
Jason Lawrence
Comment 6 2020-06-15 10:05:34 PDT
I have removed the expectations here: https://trac.webkit.org/changeset/263042/webkit