Bug 229101 - REGRESSION: [ Mac ] http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html is flaky failing
Summary: REGRESSION: [ Mac ] http/tests/media/modern-media-controls/pip-support/pip-su...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-08-13 15:44 PDT by Truitt Savell
Modified: 2021-08-24 14:30 PDT (History)
7 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Truitt Savell 2021-08-13 15:44:26 PDT 
http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html

this test is flaky failing across Mac

History:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fmodern-media-controls%2Fpip-support%2Fpip-support-live-broadcast.html

Diff:
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast-actual.txt
@@ -4,7 +4,7 @@
 
 
 PASS media.duration is Number.POSITIVE_INFINITY
-PASS mediaController.controls.pipButton.enabled is true
+FAIL mediaController.controls.pipButton.enabled should be true. Was false.
 
 PASS successfullyParsed is true
 

I can reproduce this using command:
run-webkit-tests --iterations 2000 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --debug-rwt-logging --no-retry --force --no-build -f -1 http/tests/media/modern-media-controls/pip-support/pip-support-live-broadcast.html
Comment 1 Truitt Savell 2021-08-13 15:44:55 PDT 
I am unable to make a proper bisection at this time due to some oddness with run-webkit-tests that we are looking at in another bug.
Comment 2 Radar WebKit Bug Importer 2021-08-13 15:45:12 PDT 
<rdar://problem/81919531>
Comment 3 Jonathan Bedard 2021-08-21 09:23:44 PDT 
Looking at test history, https://trac.webkit.org/changeset/280722/webkit seems to be a candidate. This was certainly not failing before August 1, 2021
Comment 4 ayumi_kojima 2021-08-23 10:39:02 PDT 
This test started showing up on macOS-Catalina-Release-WK2-Tests-EWS as flaky tests.
Comment 5 ayumi_kojima 2021-08-24 14:30:27 PDT 
Updated the test expectations to speed up EWS https://trac.webkit.org/changeset/281517/webkit