Bug 261215

Summary:	REGRESSION(267620@main): [ macOS wk2 ] webrtc/vp8-then-h264-gpu-process-crash.html is a flaky failure.
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	WebRTC	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	kkinnunen, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=261111 https://bugs.webkit.org/show_bug.cgi?id=259373

Description Ben Schwartz 2023-09-06 11:18:02 PDT

webrtc/vp8-then-h264-gpu-process-crash.html

This test is a flaky failure on macOS wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=webrtc%2Fvp8-then-h264-gpu-process-crash.html&platform=mac

TEXT DIFF:

 PASS Setting video exchange with VP8
 PASS Setting exchange with H264 using VP8 decoded stream as input
-PASS Frames should be coming even after gpu process crash
+FAIL Frames should be coming even after gpu process crash promise_test: Unhandled rejection with value: "test increasing frame decoded timed out"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267668%40main%20(4797)/webrtc/vp8-then-h264-gpu-process-crash-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) using the following command:

rwt --clobber-old-results --verbose --iterations 500 --child-processes 10 -f --exit-after-n-failures 1 webrtc/vp8-then-h264-gpu-process-crash.html

REGRESSION:

The regression point seems to be 267620@main, as this was the first instance of the failure and the changes appear directly related to the failing test.

Comment 1 Radar WebKit Bug Importer 2023-09-06 11:18:13 PDT

<rdar://problem/115066666>

Comment 2 EWS 2023-09-06 11:32:50 PDT

Test gardening commit 267684@main (8578dd9014ba): <https://commits.webkit.org/267684@main>

Reviewed commits have been landed. Closing PR #17493 and removing active labels.

Comment 3 Ryan Haddad 2023-10-20 16:04:48 PDT

This appears to have stopped flakily failing around the time https://commits.webkit.org/269258@main landed. We should remove the flaky expectation.

Comment 4 Anfernee Viduya 2024-06-21 10:31:59 PDT

Pull request: https://github.com/WebKit/WebKit/pull/30051

Comment 5 EWS 2024-06-21 10:39:23 PDT

Test gardening commit 280253@main (c7320fb2a541): <https://commits.webkit.org/280253@main>

Reviewed commits have been landed. Closing PR #30051 and removing active labels.