229101 2021-08-13 15:44:26 -0700 REGRESSION: [ Mac ] http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html is flaky failing 2021-08-24 14:30:27 -0700 1 1 1 Unclassified WebKit Media WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 tsavell webkit-unassigned ayumi_kojima graouts hi jbedard jer.noble webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1784260 0 tsavell 2021-08-13 15:44:26 -0700 http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html this test is flaky failing across Mac History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fmodern-media-controls%2Fpip-support%2Fpip-support-live-broadcast.html Diff: --- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-expected.txt +++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-actual.txt @@ -4,7 +4,7 @@ PASS media.duration is Number.POSITIVE_INFINITY -PASS mediaController.controls.pipButton.enabled is true +FAIL mediaController.controls.pipButton.enabled should be true. Was false. PASS successfullyParsed is true I can reproduce this using command: run-webkit-tests --iterations 2000 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --debug-rwt-logging --no-retry --force --no-build -f -1 http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html 1784261 1 tsavell 2021-08-13 15:44:55 -0700 I am unable to make a proper bisection at this time due to some oddness with run-webkit-tests that we are looking at in another bug. 1784262 2 webkit-bug-importer 2021-08-13 15:45:12 -0700 <rdar://problem/81919531> 1786142 3 jbedard 2021-08-21 09:23:44 -0700 Looking at test history, https://trac.webkit.org/changeset/280722/webkit seems to be a candidate. This was certainly not failing before August 1, 2021 1786471 4 ayumi_kojima 2021-08-23 10:39:02 -0700 This test started showing up on macOS-Catalina-Release-WK2-Tests-EWS as flaky tests. 1786938 5 ayumi_kojima 2021-08-24 14:30:27 -0700 Updated the test expectations to speed up EWS https://trac.webkit.org/changeset/281517/webkit