Bug 213146 - REGRESSION: (r262904): [ Mac wk1 Debug ] media/remoteplayback-target-availability.html is flaky failing.
Summary: REGRESSION: (r262904): [ Mac wk1 Debug ] media/remoteplayback-target-availabi...
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.14
: P2 Normal
Assignee: Nobody
Keywords: InRadar
Depends on:
Reported: 2020-06-12 13:54 PDT by Jason Lawrence
Modified: 2020-06-15 10:05 PDT (History)
2 users (show)

See Also:


Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-06-12 13:54:22 PDT

This test is flaky failing on Mac wk1 Debug. The first failure appears in the visual history on 6/11/2020.


--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-actual.txt
@@ -3,7 +3,7 @@
 ** test initial callback when device is unavailable
-CALLBACK( available=false )
+CALLBACK( available=true )
 ** simulate device becoming available
 CALLBACK( available=true )
Comment 1 Radar WebKit Bug Importer 2020-06-12 13:55:05 PDT
Comment 2 Jason Lawrence 2020-06-12 14:03:41 PDT
I have marked this test as flaky failing while this issue is investigated. 
Comment 3 Jason Lawrence 2020-06-12 14:37:14 PDT
I can reproduce this issue on r262972 and r262904, but I can't reproduce it on r262903.

Run-webkit-tests --debug --iterations 21 --exit-after-n-failures 3 --force -f -1 media/remoteplayback-prompt.html media/remoteplayback-target-availability.html

r262904 results:
[25/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
[29/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
[33/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
Exiting early after 3 failures. 28 tests run.

25 tests ran as expected, 3 didn't (14 didn't run):

Regressions: Unexpected text-only failures (1)
  media/remoteplayback-target-availability.html [ Failure ]

r262903 results:
All 42 tests ran as expected.
Comment 4 Jason Lawrence 2020-06-12 15:00:50 PDT
Reverted r262904 for reason:

This commit broke a test on Mac wk1 Debug.

Committed r262977: <https://trac.webkit.org/changeset/262977>
Comment 5 Alexey Proskuryakov 2020-06-14 19:52:12 PDT
The issue is fixed with a revert, but the test expectation still needs to be removed.
Comment 6 Jason Lawrence 2020-06-15 10:05:34 PDT
I have removed the expectations here: https://trac.webkit.org/changeset/263042/webkit