Layout Test media/audio-concurrent-supported.html is a flaky failure

• Component: Tools / Tests
• Status: RESOLVED CONFIGURATION CHANGED

[Dawei Fenton (:realdawei)]

The following layout test is flaky on iOS 

media/audio-concurrent-supported.html

Probable cause:

Unknown, test has been previous marked flaky in macOS:
https://bugs.webkit.org/show_bug.cgi?id=184612

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Faudio-concurrent-supported.html
--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/workers/service/serviceworkerclients-matchAll.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/workers/service/serviceworkerclients-matchAll.https-actual.txt
@@ -1,4 +1,4 @@
 
 PASS Setup worker 
-PASS Test self.clients.matchAll 
+FAIL Test self.clients.matchAll assert_equals: expected "PASS" but got "FAIL: expected one matched client, got 2"

[Dawei Fenton (:realdawei)]

Corrected the diff below:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Faudio-concurrent-supported.html
--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/media/audio-concurrent-supported-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/media/audio-concurrent-supported-actual.txt
@@ -10,7 +10,7 @@
 EVENT(1, playing)
 EXPECTED (1, testElement.currentTime > '0') OK
 Making sure all 2 audio elements are in playing state:
-EXPECTED (0, testElement.paused == 'false') OK
+EXPECTED (0, testElement.paused == 'false'), OBSERVED 'true' FAIL
 EXPECTED (1, testElement.paused == 'false') OK
 END OF TEST

[Dawei Fenton (:realdawei)]

Only appears to be happening in iOS [ Release ]


Marked as flaky in https://trac.webkit.org/changeset/234212/webkit

[Ryan Haddad]

This test does not appear to be flaky on iOS anymore. Removed expectation in https://trac.webkit.org/changeset/241206/webkit

[Radar WebKit Bug Importer]

<rdar://problem/47927377>