Bug 221422 – REGRESSION (r271341): [DEBUG MACOS WK2] media/modern-media-controls/volume-down-support/volume-down-support.html is a flakey text failure

• Component: Media
• Status: NEW

[Robert Jenner]

media/modern-media-controls/volume-down-support/volume-down-support.html

Is a flakey text failure in Debug MacOS WK2. 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=media%2Fmodern-media-controls%2Fvolume-down-support%2Fvolume-down-support.html

DIFF URLs: 
r272369: https://build.webkit.org/results/Apple-BigSur-Debug-WK2-Tests/r272369%20(1073)/media/modern-media-controls/volume-down-support/volume-down-support-pretty-diff.html

r271342: https://build.webkit.org/results/Apple-BigSur-Debug-WK2-Tests/r271342%20(651)/media/modern-media-controls/volume-down-support/volume-down-support-pretty-diff.html

DIFF TEXT:
--- /Volumes/Data/slave/bigsur-debug-tests-wk2/build/layout-test-results/media/modern-media-controls/volume-down-support/volume-down-support-expected.txt
+++ /Volumes/Data/slave/bigsur-debug-tests-wk2/build/layout-test-results/media/modern-media-controls/volume-down-support/volume-down-support-actual.txt
@@ -3,15 +3,8 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 
-PASS !!internals.shadowRoot(media).querySelector("button.volume-down") became true
-PASS media.webkitDisplayingFullscreen is true
-PASS media.volume is 0.5
-PASS volumeSlider.getBoundingClientRect().left became 196
-
-Pressing on the volume down button
-PASS media.volume is 0
-
+Toggling fullscreen failed
 PASS successfullyParsed is true
 
 TEST COMPLETE
-
+Enter fullscreen


Most recent failure reported on r272369. 

History indicates flakey failures started at r271342

Compared reported failures, and confirmed that they are the same failures in the history.

[Robert Jenner]

Reproduced bug in r272368 with the following test:

run-webkit-test media/modern-media-controls/volume-down-support/volume-down-support.html   --iterations 1000 --debug --child-process=50

Received same failure:

TEXT DIFF:
--- /Volumes/Data/Spades/testbuild-272368/layout-test-results/media/modern-media-controls/volume-down-support/volume-down-support-expected.txt
+++ /Volumes/Data/Spades/testbuild-272368/layout-test-results/media/modern-media-controls/volume-down-support/volume-down-support-actual.txt
@@ -3,15 +3,8 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 
-PASS !!internals.shadowRoot(media).querySelector("button.volume-down") became true
-PASS media.webkitDisplayingFullscreen is true
-PASS media.volume is 0.5
-PASS volumeSlider.getBoundingClientRect().left became 196
-
-Pressing on the volume down button
-PASS media.volume is 0
-
+Toggling fullscreen failed
 PASS successfullyParsed is true
 
 TEST COMPLETE
-
+Enter fullscreen

[Radar WebKit Bug Importer]

<rdar://problem/73991516>

[Robert Jenner]

Bisected and found the regression point. Flakey text failure was reproduced in r271342, and not in r271341 or 200 regressions back.

[Alexey Proskuryakov]

r271342 just removed another test. Robert, how did you reproduce?