Bug 213146

Summary:	REGRESSION: (r262904): [ Mac wk1 Debug ] media/remoteplayback-target-availability.html is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	macOS 10.14
See Also:	https://bugs.webkit.org/show_bug.cgi?id=213063

Description Jason Lawrence 2020-06-12 13:54:22 PDT

media/remoteplayback-target-availability.html

Description:
This test is flaky failing on Mac wk1 Debug. The first failure appears in the visual history on 6/11/2020.

History:
https://results.webkit.org/?suite=layout-tests&test=media%2Fremoteplayback-target-availability.html&flavor=wk1&platform=mac&style=debug

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/media/remoteplayback-target-availability-actual.txt
@@ -3,7 +3,7 @@
 
 
 ** test initial callback when device is unavailable
-CALLBACK( available=false )
+CALLBACK( available=true )
 
 ** simulate device becoming available
 CALLBACK( available=true )

Comment 1 Radar WebKit Bug Importer 2020-06-12 13:55:05 PDT

<rdar://problem/64310841>

Comment 2 Jason Lawrence 2020-06-12 14:03:41 PDT

I have marked this test as flaky failing while this issue is investigated. 
https://trac.webkit.org/changeset/262976/webkit

Comment 3 Jason Lawrence 2020-06-12 14:37:14 PDT

I can reproduce this issue on r262972 and r262904, but I can't reproduce it on r262903.

Command:
Run-webkit-tests --debug --iterations 21 --exit-after-n-failures 3 --force -f -1 media/remoteplayback-prompt.html media/remoteplayback-target-availability.html

r262904 results:
[25/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
[29/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
[33/42] media/remoteplayback-target-availability.html failed unexpectedly (text diff)
Exiting early after 3 failures. 28 tests run.

25 tests ran as expected, 3 didn't (14 didn't run):

Regressions: Unexpected text-only failures (1)
  media/remoteplayback-target-availability.html [ Failure ]


r262903 results:
All 42 tests ran as expected.

Comment 4 Jason Lawrence 2020-06-12 15:00:50 PDT

Reverted r262904 for reason:

This commit broke a test on Mac wk1 Debug.

Committed r262977: <https://trac.webkit.org/changeset/262977>

Comment 5 Alexey Proskuryakov 2020-06-14 19:52:12 PDT

The issue is fixed with a revert, but the test expectation still needs to be removed.

Comment 6 Jason Lawrence 2020-06-15 10:05:34 PDT

I have removed the expectations here: https://trac.webkit.org/changeset/263042/webkit