Bug 223770

Summary:	[MacOS Wk1] media/video-playback-quality.html is a flaky failure
Product:	WebKit	Reporter:	Amir Mark Jr <amir_mark>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Amir Mark Jr 2021-03-25 15:58:00 PDT

media/video-playback-quality.html

Is a flaky failure on Big Sur Wk1 Debug and Release, and Apple Silicon Debug and Release


History:

https://results.webkit.org/?suite=layout-tests&test=media%2Fvideo-playback-quality.html

Text Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/media/video-playback-quality-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/media/video-playback-quality-actual.txt
@@ -12,6 +12,6 @@
 EXPECTED (newQuality.creationTime > originalQuality.creationTime == 'true') OK
 EXPECTED (newQuality.totalVideoFrames >= originalQuality.totalVideoFrames == 'true') OK
 EXPECTED (newQuality.droppedVideoFrames >= originalQuality.droppedVideoFrames == 'true') OK
-EXPECTED (newQuality.droppedVideoFrames <= originalQuality.totalVideoFrames == 'true') OK
+EXPECTED (newQuality.droppedVideoFrames <= originalQuality.totalVideoFrames == 'true'), OBSERVED 'false' FAIL
 END OF TEST

Comment 1 Radar WebKit Bug Importer 2021-03-25 15:58:18 PDT

<rdar://problem/75857723>

Comment 2 Amir Mark Jr 2021-05-13 12:01:18 PDT

This test is also having flaky issues on Catalina E wk1 Release

Comment 3 Amir Mark Jr 2021-05-13 12:42:12 PDT

Updated test expectations:

http://trac.webkit.org/changeset/277445/webkit