Bug 229101

Summary:	REGRESSION: [ Mac ] http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html is flaky failing
Product:	WebKit	Reporter:	Truitt Savell <tsavell>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	ayumi_kojima, graouts, hi, jbedard, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Truitt Savell 2021-08-13 15:44:26 PDT

http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html

this test is flaky failing across Mac

History:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fmodern-media-controls%2Fpip-support%2Fpip-support-live-broadcast.html

Diff:
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-actual.txt
@@ -4,7 +4,7 @@
 
 
 PASS media.duration is Number.POSITIVE_INFINITY
-PASS mediaController.controls.pipButton.enabled is true
+FAIL mediaController.controls.pipButton.enabled should be true. Was false.
 
 PASS successfullyParsed is true
 

I can reproduce this using command:
run-webkit-tests --iterations 2000 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --debug-rwt-logging --no-retry --force --no-build -f -1 http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html

Comment 1 Truitt Savell 2021-08-13 15:44:55 PDT

I am unable to make a proper bisection at this time due to some oddness with run-webkit-tests that we are looking at in another bug.

Comment 2 Radar WebKit Bug Importer 2021-08-13 15:45:12 PDT

<rdar://problem/81919531>

Comment 3 Jonathan Bedard 2021-08-21 09:23:44 PDT

Looking at test history, https://trac.webkit.org/changeset/280722/webkit seems to be a candidate. This was certainly not failing before August 1, 2021

Comment 4 ayumi_kojima 2021-08-23 10:39:02 PDT

This test started showing up on macOS-Catalina-Release-WK2-Tests-EWS as flaky tests.

Comment 5 ayumi_kojima 2021-08-24 14:30:27 PDT

Updated the test expectations to speed up EWS https://trac.webkit.org/changeset/281517/webkit