Bug 229206

Summary:	[ MacOS wk2 Debug ] http/wpt/webrtc/sframe-transform-error.html is a flaky failure
Product:	WebKit	Reporter:	ayumi_kojima
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	eric.carlson, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac (Intel)
OS:	Unspecified

Description ayumi_kojima 2021-08-17 14:52:39 PDT

http/wpt/webrtc/sframe-transform-error.html

Is flaky failing on MacOS wk2 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=http%2Fwpt%2Fwebrtc%2Fsframe-transform-error.html

Diff: 

--- /Volumes/Data/worker/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/http/wpt/webrtc/sframe-transform-error-expected.txt
+++ /Volumes/Data/worker/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/http/wpt/webrtc/sframe-transform-error-actual.txt
@@ -1,5 +1,5 @@
 
 
 PASS Missing key triggers an error that can be corrected by adding a key
-PASS Tampered data should trigger SFrameTransform errors
+FAIL Tampered data should trigger SFrameTransform errors assert_equals: expected "authentication" but got "keyID"
 
Result page: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-GPUProcess-Tests/r281129%20(2007)/results.html

Comment 1 Radar WebKit Bug Importer 2021-08-17 14:53:04 PDT

<rdar://problem/82047975>

Comment 2 ayumi_kojima 2021-08-17 17:13:03 PDT

Updated test expectations: https://trac.webkit.org/changeset/281174/webkit

Comment 3 ayumi_kojima 2021-08-27 17:00:09 PDT

I was able to reproduce the failure locally using run-webkit-tests --iterations 50 --exit-after-n-failures 1 --force http/wpt/webrtc/sframe-transform-error.html --debug.

The test failed at TOT and r280958 when test was added.