Bug 261356 - [ macOS wk2 debug ] fast/mediastream/device-change-event-2.html is a flaky failure.
Summary: [ macOS wk2 debug ] fast/mediastream/device-change-event-2.html is a flaky fa...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-09-08 14:58 PDT by Ben Schwartz
Modified: 2023-11-14 02:14 PST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-09-08 14:58:14 PDT
fast/mediastream/device-change-event-2.html

This test is a flaky failure on debug builds of macOS wk2 (mostly on x86_64 with occasional failures on arm64).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=fast%2Fmediastream%2Fdevice-change-event-2.html

TEXT DIFF (though the test seems to fail with different messages each time):

 CONSOLE MESSAGE: A MediaStreamTrack ended due to a capture failure
 CONSOLE MESSAGE: A MediaStreamTrack ended due to a capture failure
+CONSOLE MESSAGE: Error: assert_true: devicechange should only fire when the document is focused and active expected true got false
+
+Harness Error (FAIL), message = Error: assert_true: devicechange should only fire when the document is focused and active expected true got false
 
 PASS 'devicechange' event fired when device list changes
 PASS 'devicechange' events fired quickly are coalesced

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-WK2-Tests/267790@main%20(2946)/fast/mediastream/device-change-event-2-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue constantly on macOS Ventura (13.5, 22G74/x86_64) WK2 debug at 267085@main using the following command:

run-webkit-tests --clobber-old-results --debug --verbose --iterations 50 fast/mediastream/device-change-event-2.html

REGRESSION:

I was unable to locate a regression point; however, according to the related issue, this issue (or similar) has existed since 225536@main.
Comment 1 Radar WebKit Bug Importer 2023-09-08 14:58:24 PDT
<rdar://problem/115192271>
Comment 2 EWS 2023-09-08 15:39:07 PDT
Test gardening commit 267812@main (5365867e4889): <https://commits.webkit.org/267812@main>

Reviewed commits have been landed. Closing PR #17613 and removing active labels.
Comment 3 youenn fablet 2023-10-05 06:38:20 PDT
Pull request: https://github.com/WebKit/WebKit/pull/18691
Comment 4 EWS 2023-10-06 01:54:49 PDT
Committed 268976@main (ebcddfddefbd): <https://commits.webkit.org/268976@main>

Reviewed commits have been landed. Closing PR #18691 and removing active labels.
Comment 5 Ben Schwartz 2023-10-19 09:44:17 PDT
Re-setting previous expectation in mac-wk2:

`webkit.org/b/188924 fast/mediastream/device-change-event-2.html [ Pass Timeout ]`
Comment 6 EWS 2023-10-19 17:23:38 PDT
Test gardening commit 269550@main (79ceb52cc4ec): <https://commits.webkit.org/269550@main>

Reviewed commits have been landed. Closing PR #19319 and removing active labels.
Comment 7 Alexey Proskuryakov 2023-10-23 10:27:27 PDT
Ben's above commit re-added an expectation, because this is still happening. Reopening the bug, too.
Comment 8 youenn fablet 2023-11-10 06:52:24 PST
Pull request: https://github.com/WebKit/WebKit/pull/20306
Comment 9 EWS 2023-11-14 02:14:23 PST
Committed 270702@main (2d5fd917570a): <https://commits.webkit.org/270702@main>

Reviewed commits have been landed. Closing PR #20306 and removing active labels.