Bug 232025 - [ iOS Release ] media/media-can-play-mpeg-audio.html is a flaky failure
Summary: [ iOS Release ] media/media-can-play-mpeg-audio.html is a flaky failure
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: iPhone / iPad Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-20 11:13 PDT by ayumi_kojima
Modified: 2022-07-07 14:09 PDT (History)
7 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-10-20 11:13:40 PDT 
media/media-can-play-mpeg-audio.html 

Is a flaky failure on iOS 15 Release.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Fmedia-can-play-mpeg-audio.html

Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/r284525%20(239)/results.html

Diff:

--- /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/media/media-can-play-mpeg-audio-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/media/media-can-play-mpeg-audio-actual.txt
@@ -3,11 +3,11 @@
 
 These tests may be expected to fail if the WebKit port does not support the format.
 
-EXPECTED (audio.canPlayType('audio/x-mpeg') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/x-mp3') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/mp3') == 'maybe') OK
+EXPECTED (audio.canPlayType('audio/x-mpeg') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/x-mp3') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/mp3') == 'maybe'), OBSERVED '' FAIL
 EXPECTED (audio.canPlayType('audio/mpeg') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/mp4') == 'maybe') OK
-EXPECTED (audio.canPlayType('audio/aac') == 'maybe') OK
+EXPECTED (audio.canPlayType('audio/mp4') == 'maybe'), OBSERVED '' FAIL
+EXPECTED (audio.canPlayType('audio/aac') == 'maybe'), OBSERVED '' FAIL
 END OF TEST
Comment 1 Radar WebKit Bug Importer 2021-10-20 11:17:19 PDT 
<rdar://problem/84470948>
Comment 2 ayumi_kojima 2021-10-20 11:22:59 PDT 
Marked test expectations https://trac.webkit.org/changeset/284552/webkit
Comment 3 ayumi_kojima 2021-10-26 15:13:02 PDT 
I was not able to reproduce the failure locally on iOS 15 sim using run-webkit-tests --force --ios-simulator --iterations 500 --exit-after-n-failures 1 media/media-can-play-mpeg-audio.html -f.
Comment 4 Brent Fulgham 2022-06-23 14:43:06 PDT 
Jer Noble confirmed this is no longer happening as of 5/3/2022.
Comment 5 Hercules Hjalmarsson 2022-07-07 14:09:48 PDT 
Manually adding commit message since not automatically generated.

> Test gardening commit 252225@main (07f9e0f):
> <https://commits.webkit.org/252225@main>
> 
> Reviewed commits have been landed. Closing PR #2103 and removing active
> labels.

Removed expectations in above commit.