Bug 260225 - New test: imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-GC.https.html is a consistent/flaky text failure.
Summary: New test: imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-GC.https.h...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
: 267598 (view as bug list)
Depends on:
Blocks:
 
Reported: 2023-08-15 15:38 PDT by Ben Schwartz
Modified: 2024-01-16 11:13 PST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-08-15 15:38:24 PDT
imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-GC.https.html

This test is a consistent failure on macOS and a very flaky failure on iOS.
On macOS, it fails much more often on x86_64.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-GC.https.html&recent=false

TEXT DIFF:

-PASS GC does not collect a peer connection pipe rendering to a video element
+FAIL GC does not collect a peer connection pipe rendering to a video element assert_not_equals: got disallowed value 18.92

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/266924@main%20(4460)/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-GC.https-diff.txt

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (arm64) Release ToT running the test as follows:

run-webkit-tests --iterations 100 --exit-after-n-failures 1 --verbose imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-GC.https.html

REGRESSION:

This bug started with a WPT test import batch at 264111@main.
Comment 1 Radar WebKit Bug Importer 2023-08-15 15:38:36 PDT
<rdar://problem/113932040>
Comment 2 EWS 2023-08-15 16:03:59 PDT
Test gardening commit 266930@main (729dbedfe129): <https://commits.webkit.org/266930@main>

Reviewed commits have been landed. Closing PR #16724 and removing active labels.
Comment 3 Ben Schwartz 2023-08-15 16:52:52 PDT
I have marked this test as a flaky failure while the issue is being investigated. (PR link: https://github.com/WebKit/WebKit/pull/16724)
Comment 4 youenn fablet 2023-11-14 06:23:11 PST
Pull request: https://github.com/WebKit/WebKit/pull/20479
Comment 5 youenn fablet 2023-11-14 06:26:31 PST
Submitted web-platform-tests pull request: https://github.com/web-platform-tests/wpt/pull/43153
Comment 6 EWS 2023-11-17 02:29:08 PST
Committed 270875@main (4777271bc315): <https://commits.webkit.org/270875@main>

Reviewed commits have been landed. Closing PR #20479 and removing active labels.
Comment 7 EWS 2023-11-28 13:34:51 PST
Test gardening commit 271235@main (59546000df23): <https://commits.webkit.org/271235@main>

Reviewed commits have been landed. Closing PR #21014 and removing active labels.
Comment 8 youenn fablet 2024-01-16 11:13:08 PST
*** Bug 267598 has been marked as a duplicate of this bug. ***