Bug 188017 - Layout Test media/audio-concurrent-supported.html is a flaky failure
Summary: Layout Test media/audio-concurrent-supported.html is a flaky failure
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2018-07-25 13:25 PDT by Dawei Fenton (:realdawei)
Modified: 2019-02-08 13:23 PST (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Dawei Fenton (:realdawei) 2018-07-25 13:25:28 PDT
The following layout test is flaky on iOS 

media/audio-concurrent-supported.html

Probable cause:

Unknown, test has been previous marked flaky in macOS:
https://bugs.webkit.org/show_bug.cgi?id=184612

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Faudio-concurrent-supported.html
--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/workers/service/serviceworkerclients-matchAll.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/http/tests/workers/service/serviceworkerclients-matchAll.https-actual.txt
@@ -1,4 +1,4 @@
 
 PASS Setup worker 
-PASS Test self.clients.matchAll 
+FAIL Test self.clients.matchAll assert_equals: expected "PASS" but got "FAIL: expected one matched client, got 2"
Comment 1 Dawei Fenton (:realdawei) 2018-07-25 13:29:57 PDT
Corrected the diff below:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Faudio-concurrent-supported.html
--- /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/media/audio-concurrent-supported-expected.txt
+++ /Volumes/Data/slave/ios-simulator-11-release-tests-wk2/build/layout-test-results/media/audio-concurrent-supported-actual.txt
@@ -10,7 +10,7 @@
 EVENT(1, playing)
 EXPECTED (1, testElement.currentTime > '0') OK
 Making sure all 2 audio elements are in playing state:
-EXPECTED (0, testElement.paused == 'false') OK
+EXPECTED (0, testElement.paused == 'false'), OBSERVED 'true' FAIL
 EXPECTED (1, testElement.paused == 'false') OK
 END OF TEST
Comment 2 Dawei Fenton (:realdawei) 2018-07-25 13:48:20 PDT
Only appears to be happening in iOS [ Release ]


Marked as flaky in https://trac.webkit.org/changeset/234212/webkit
Comment 3 Ryan Haddad 2019-02-08 13:22:09 PST
This test does not appear to be flaky on iOS anymore. Removed expectation in https://trac.webkit.org/changeset/241206/webkit
Comment 4 Radar WebKit Bug Importer 2019-02-08 13:23:27 PST
<rdar://problem/47927377>