Bug 232025

Summary:	[ iOS Release ] media/media-can-play-mpeg-audio.html is a flaky failure
Product:	WebKit	Reporter:	ayumi_kojima
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	bfulgham, eric.carlson, hhjalmarsson, hi, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	iPhone / iPad
OS:	Unspecified

Description ayumi_kojima 2021-10-20 11:13:40 PDT

media/media-can-play-mpeg-audio.html 

Is a flaky failure on iOS 15 Release.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Fmedia-can-play-mpeg-audio.html

Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/r284525%20(239)/results.html

Diff:

--- /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/media/media-can-play-mpeg-audio-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/media/media-can-play-mpeg-audio-actual.txt
@@ -3,11 +3,11 @@
 
 These tests may be expected to fail if the WebKit port does not support the format.
 
-EXPECTED (audio.canPlayType('audio/x-mpeg') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/x-mp3') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/mp3') == 'maybe') OK
+EXPECTED (audio.canPlayType('audio/x-mpeg') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/x-mp3') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/mp3') == 'maybe'), OBSERVED '' FAIL
 EXPECTED (audio.canPlayType('audio/mpeg') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/mp4') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/aac') == 'maybe') OK
+EXPECTED (audio.canPlayType('audio/mp4') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/aac') == 'maybe'), OBSERVED '' FAIL
 END OF TEST

Comment 1 Radar WebKit Bug Importer 2021-10-20 11:17:19 PDT

<rdar://problem/84470948>

Comment 2 ayumi_kojima 2021-10-20 11:22:59 PDT

Marked test expectations https://trac.webkit.org/changeset/284552/webkit

Comment 3 ayumi_kojima 2021-10-26 15:13:02 PDT

I was not able to reproduce the failure locally on iOS 15 sim using run-webkit-tests --force --ios-simulator --iterations 500 --exit-after-n-failures 1 media/media-can-play-mpeg-audio.html -f.

Comment 4 Brent Fulgham 2022-06-23 14:43:06 PDT

Jer Noble confirmed this is no longer happening as of 5/3/2022.

Comment 5 Hercules Hjalmarsson 2022-07-07 14:09:48 PDT

Manually adding commit message since not automatically generated.

> Test gardening commit 252225@main (07f9e0f):
> <https://commits.webkit.org/252225@main>
> 
> Reviewed commits have been landed. Closing PR #2103 and removing active
> labels.

Removed expectations in above commit.