229206 2021-08-17 14:52:39 -0700 [ MacOS wk2 Debug ] http/wpt/webrtc/sframe-transform-error.html is a flaky failure 2021-08-27 17:00:22 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Mac (Intel) Unspecified NEW InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned eric.carlson webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1784938 0 ayumi_kojima 2021-08-17 14:52:39 -0700 http/wpt/webrtc/sframe-transform-error.html Is flaky failing on MacOS wk2 Debug. History: https://results.webkit.org/?suite=layout-tests&test=http%2Fwpt%2Fwebrtc%2Fsframe-transform-error.html Diff: --- /Volumes/Data/worker/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/http/wpt/webrtc/sframe-transform-error-expected.txt +++ /Volumes/Data/worker/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/http/wpt/webrtc/sframe-transform-error-actual.txt @@ -1,5 +1,5 @@ PASS Missing key triggers an error that can be corrected by adding a key -PASS Tampered data should trigger SFrameTransform errors +FAIL Tampered data should trigger SFrameTransform errors assert_equals: expected "authentication" but got "keyID" Result page: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-GPUProcess-Tests/r281129%20(2007)/results.html 1784939 1 webkit-bug-importer 2021-08-17 14:53:04 -0700 <rdar://problem/82047975> 1784999 2 ayumi_kojima 2021-08-17 17:13:03 -0700 Updated test expectations: https://trac.webkit.org/changeset/281174/webkit 1788237 3 ayumi_kojima 2021-08-27 17:00:09 -0700 I was able to reproduce the failure locally using run-webkit-tests --iterations 50 --exit-after-n-failures 1 --force http/wpt/webrtc/sframe-transform-error.html --debug. The test failed at TOT and r280958 when test was added.