217263 2020-10-02 18:05:14 -0700 [ iOS ] 2 mediacapture-record tests are a constant failure 2020-10-20 09:42:35 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified REOPENED https://bugs.webkit.org/show_bug.cgi?id=217262 InRadar P2 Normal --- 1 hector_i_lopez youennf webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1694309 0 hector_i_lopez 2020-10-02 18:05:14 -0700 imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-no-sink.https.html imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html Tests are constant failures according to history on iOS. First occurrence of failures on iOS coincide with first testing on iOS. Both test were passing on macOS until r267870. From that point test imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html became flaky on macOS Catalina wk2 Debug/Release. History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-no-sink.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-peerconnection.https.html Diff iOS for imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-no-sink.https.html: --- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-no-sink.https-expected.txt +++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-no-sink.https-actual.txt @@ -1,5 +1,7 @@ + +Harness Error (TIMEOUT), message = null PASS PeerConnection MediaRecorder records audio from PeerConnection without sinks PASS PeerConnection MediaRecorder records video from PeerConnection without sinks -PASS PeerConnection MediaRecorder records audio/video from PeerConnection without sinks +TIMEOUT PeerConnection MediaRecorder records audio/video from PeerConnection without sinks Test timed out Diff iOS for imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html --- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https-expected.txt +++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https-actual.txt @@ -6,8 +6,8 @@ PASS PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format [passthrough]. PASS PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format [passthrough]. PASS PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format [passthrough]. -PASS PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format [passthrough]. -TIMEOUT PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format [passthrough]. Test timed out +TIMEOUT PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format [passthrough]. Test timed out +NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format [passthrough]. NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format video/webm;codecs=vp8. NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format video/webm;codecs=vp8. NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format video/webm;codecs=vp8. Diff macOS for imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html --- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https-expected.txt +++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https-actual.txt @@ -1,23 +1,21 @@ - -Harness Error (TIMEOUT), message = null PASS PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format [passthrough]. PASS PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format [passthrough]. PASS PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format [passthrough]. PASS PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format [passthrough]. PASS PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format [passthrough]. -TIMEOUT PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format [passthrough]. Test timed out -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format video/webm;codecs=vp8. -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format video/webm;codecs=vp9. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format video/webm;codecs=vp9. -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format video/webm;codecs=vp9. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format video/webm;codecs=vp9. -NOTRUN PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format video/webm;codecs=vp9. -NOTRUN PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format video/webm;codecs=vp9. +PASS PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format [passthrough]. +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format video/webm;codecs=vp8. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":false,"audio":true} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":false,"audio":true} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":false} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":false} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder receives data after onstart, {"video":true,"audio":true} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" +FAIL PeerConnection MediaRecorder gets ondata on stopping recorded tracks {"video":true,"audio":true} with format video/webm;codecs=vp9. promise_test: Unhandled rejection with value: object "NotSupportedError: mimeType is not supported" Reproduction for imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html on macOS Catalina wk 2 Release on r267897 run-webkit-tests imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html --iterations 1000 --exit-after-n-failures 3 Result: Baseline search path: platform/mac-catalina -> Internal/Tests/LayoutTestsResultsForUnreleasedSoftware/mac-wk2 -> platform/mac-wk2 -> Internal/Tests/LayoutTestsResultsForUnreleasedSoftware/mac -> platform/mac -> platform/wk2 -> generic Running 1 test Running 1 WebKitTestRunner. [1/1000] imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html failed unexpectedly (text diff) [2/1000] imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html failed unexpectedly (text diff) [3/1000] imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html failed unexpectedly (text diff) Exiting early after 3 failures. 3 tests run. 0 tests ran as expected, 3 didn't (997 didn't run): Regressions: Unexpected text-only failures (1) imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-peerconnection.https.html [ Failure ] 1694310 1 webkit-bug-importer 2020-10-02 18:05:31 -0700 <rdar://problem/69904225> 1694315 2 hector_i_lopez 2020-10-02 18:15:21 -0700 See webkit.org/b/217262 for test expectations for Mac Test expectations for iOS: 1694316 3 hector_i_lopez 2020-10-02 18:18:36 -0700 Test expectations for iOS: https://trac.webkit.org/changeset/267905/webkit See test expectation for Mac: https://trac.webkit.org/changeset/267904/webkit 1696823 4 411109 youennf 2020-10-12 05:15:23 -0700 Created attachment 411109 Patch 1696832 5 ews-feeder 2020-10-12 06:55:30 -0700 commit-queue failed to commit attachment 411109 to WebKit repository. 1696915 6 ews-feeder 2020-10-12 10:37:42 -0700 Committed r268361: <https://trac.webkit.org/changeset/268361> All reviewed patches have been landed. Closing bug and clearing flags on attachment 411109. 1697180 7 youennf 2020-10-12 23:40:28 -0700 Reopening for further investigation 1699780 8 hector_i_lopez 2020-10-20 09:42:35 -0700 imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-no-sink.https.html Test expectation adjustment: https://trac.webkit.org/changeset/268737/webkit 411109 2020-10-12 05:15:23 -0700 2020-10-12 10:37:42 -0700 Patch bug-217263-20201012141521.patch text/plain 3260 youennf U3VidmVyc2lvbiBSZXZpc2lvbjogMjY4MzQyCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggYjNmMmQ4YzQxMzFmMjJmMmM0Nzdl NzY5NzNmZTM3NDg2NDQ3YzNmYS4uNmRkOWE3YmE3NmVkYWZhZDJhMjc2MjYzODJhODY2NDcwOWFh N2RkOSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDE1IEBACisyMDIwLTEwLTEyICBZb3Vlbm4gRmFibGV0ICA8 eW91ZW5uQGFwcGxlLmNvbT4KKworICAgICAgICBbIGlPUyBdIDIgbWVkaWFjYXB0dXJlLXJlY29y ZCB0ZXN0cyBhcmUgYSBjb25zdGFudCBmYWlsdXJlCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJr aXQub3JnL3Nob3dfYnVnLmNnaT9pZD0yMTcyNjMKKyAgICAgICAgPHJkYXI6Ly9wcm9ibGVtLzY5 OTA0MjI1PgorCisgICAgICAgIFVucmV2aWV3ZWQuCisgICAgICAgIE1hcmtpbmcgc29tZSB0ZXN0 cyBhcyBzbG93LgorCisgICAgICAgICogcGxhdGZvcm0vaW9zLXNpbXVsYXRvci13azIvVGVzdEV4 cGVjdGF0aW9uczoKKyAgICAgICAgKiBwbGF0Zm9ybS9pb3Mtd2syL1Rlc3RFeHBlY3RhdGlvbnM6 CisKIDIwMjAtMTAtMTIgIFlvdWVubiBGYWJsZXQgIDx5b3Vlbm5AYXBwbGUuY29tPgogCiAgICAg ICAgIFJFR1JFU1NJT046IFsgQ2F0YWxpbmEgd2syIF0gaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9y bS10ZXN0cy9tZWRpYWNhcHR1cmUtcmVjb3JkL01lZGlhUmVjb3JkZXItcGVlcmNvbm5lY3Rpb24u aHR0cHMuaHRtbCBpcyBhIGZsYWt5IGZhaWx1cmUKZGlmZiAtLWdpdCBhL0xheW91dFRlc3RzL3Bs YXRmb3JtL2lvcy1zaW11bGF0b3Itd2syL1Rlc3RFeHBlY3RhdGlvbnMgYi9MYXlvdXRUZXN0cy9w bGF0Zm9ybS9pb3Mtc2ltdWxhdG9yLXdrMi9UZXN0RXhwZWN0YXRpb25zCmluZGV4IDhhM2E5ODk3 Zjk3Zjc3NjYxOWUzMjVlZTZlMTAwMTc5OWM3NDIwMWYuLjI5NzI0MzgxZTEyOTE5OWI3NTI5MWE1 ZGZmYzQ2YjczOTE2NTBhZDUgMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3RzL3BsYXRmb3JtL2lvcy1z aW11bGF0b3Itd2syL1Rlc3RFeHBlY3RhdGlvbnMKKysrIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0v aW9zLXNpbXVsYXRvci13azIvVGVzdEV4cGVjdGF0aW9ucwpAQCAtNDcsOCArNDcsNiBAQCBodHRw L3dwdC9mZXRjaC9yZXNwb25zZS1vcGFxdWUtY2xvbmUuaHRtbCBbIFNsb3cgXQogaHR0cC93cHQv Y2FjaGUtc3RvcmFnZS9hLWNhY2hlLW9wZW4uaHR0cHMuaHRtbCBbIFNsb3cgXQogaHR0cC93cHQv Y2FjaGUtc3RvcmFnZS9jYWNoZS1xdW90YS1hZGQuYW55Lmh0bWwgWyBTbG93IF0KIAotd2Via2l0 Lm9yZy9iLzE5NjQwMyBpbXBvcnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRlc3RzL21lZGlhY2FwdHVy ZS1yZWNvcmQvTWVkaWFSZWNvcmRlci1zdG9wLmh0bWwgWyBQYXNzIEZhaWx1cmUgXQotCiB3ZWJr aXQub3JnL2IvMTk1MzQxIGZhc3Qvdmlld3BvcnQvaW9zL2NvbnN0YW50LXdpZHRoLXZpZXdwb3J0 LWFmdGVyLWNoYW5naW5nLXZpZXctc2NhbGUuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCiAKIHdlYmtp dC5vcmcvYi8xODY1ODEgWyBEZWJ1ZyBdIGZhc3QvcGFyc2VyL3htbC1lcnJvci1hZG9wdGVkLnht bCBbIFBhc3MgVGltZW91dCBdCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9pb3Mt d2syL1Rlc3RFeHBlY3RhdGlvbnMgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9pb3Mtd2syL1Rlc3RF eHBlY3RhdGlvbnMKaW5kZXggMjAxNTFjODc4Zjg4Mzk2YjJkMzU3YTJmZThkOTVhYTNhYWY1MTZm Yi4uMmIxMDZiMzRhMmI4NDgwOTkyZGRhMmY4OWJjODljZTY2YzY1OTZlYyAxMDA2NDQKLS0tIGEv TGF5b3V0VGVzdHMvcGxhdGZvcm0vaW9zLXdrMi9UZXN0RXhwZWN0YXRpb25zCisrKyBiL0xheW91 dFRlc3RzL3BsYXRmb3JtL2lvcy13azIvVGVzdEV4cGVjdGF0aW9ucwpAQCAtMTg5MSwxNCArMTg5 MSwxNCBAQCB3ZWJraXQub3JnL2IvMjE3MjU3IHdlYmdsLzEuMC4zL2NvbmZvcm1hbmNlL3RleHR1 cmVzL3RleC1pbWFnZS1hbmQtc3ViLWltYWdlLTJkLQogCiB3ZWJraXQub3JnL2IvMjE3MjU4IHN2 Zy9XM0MtSTE4Ti90c3Bhbi1kaXJlY3Rpb24tcnRsLnN2ZyBbIEZhaWx1cmUgXQogCi13ZWJraXQu b3JnL2IvMjE3MjYzIGltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvbWVkaWFjYXB0dXJl LXJlY29yZC9NZWRpYVJlY29yZGVyLW5vLXNpbmsuaHR0cHMuaHRtbCBbIEZhaWx1cmUgXQord2Vi a2l0Lm9yZy9iLzIxNzI2MyBpbXBvcnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRlc3RzL21lZGlhY2Fw dHVyZS1yZWNvcmQvTWVkaWFSZWNvcmRlci1uby1zaW5rLmh0dHBzLmh0bWwgWyBTbG93IEZhaWx1 cmUgXQogCi13ZWJraXQub3JnL2IvMjE3MjYzIGltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVz dHMvbWVkaWFjYXB0dXJlLXJlY29yZC9NZWRpYVJlY29yZGVyLXBlZXJjb25uZWN0aW9uLmh0dHBz Lmh0bWwgWyBGYWlsdXJlIF0KK3dlYmtpdC5vcmcvYi8yMTcyNjMgaW1wb3J0ZWQvdzNjL3dlYi1w bGF0Zm9ybS10ZXN0cy9tZWRpYWNhcHR1cmUtcmVjb3JkL01lZGlhUmVjb3JkZXItcGVlcmNvbm5l Y3Rpb24uaHR0cHMuaHRtbCBbIFNsb3cgRmFpbHVyZSBdCisKK3dlYmtpdC5vcmcvYi8xOTY0MDMg aW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy9tZWRpYWNhcHR1cmUtcmVjb3JkL01lZGlh UmVjb3JkZXItc3RvcC5odG1sIFsgUGFzcyBGYWlsdXJlIFNsb3cgXQogCiB3ZWJraXQub3JnL2Iv MjE3MjY4IGltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvbWF0aG1sL3JlbGF0aW9ucy9j c3Mtc3R5bGluZy9wYWRkaW5nLWJvcmRlci1tYXJnaW4vYm9yZGVyLTAwMi5odG1sIFsgRmFpbHVy ZSBdCiAKIHdlYmtpdC5vcmcvYi8yMTcyNjggaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0 cy9tYXRobWwvcmVsYXRpb25zL2h0bWw1LXRyZWUvZHluYW1pYy1jaGlsZGxpc3QtMDAxLmh0bWwg WyBGYWlsdXJlIF0KIAogd2Via2l0Lm9yZy9iLzIxNzQwOCBodHRwL3Rlc3RzL2NhY2hlLXN0b3Jh Z2UvcGFnZS1jYWNoZS1kb21jYWNoZS1wZW5kaW5nLXByb21pc2UuaHRtbCBbIFBhc3MgRmFpbHVy ZSBdCi0KLXdlYmtpdC5vcmcvYi8yMTc1MzggWyBEZWJ1ZyBdIGltcG9ydGVkL3czYy93ZWItcGxh dGZvcm0tdGVzdHMvbWVkaWFjYXB0dXJlLXJlY29yZC9NZWRpYVJlY29yZGVyLXN0b3AuaHRtbCBb IFRpbWVvdXQgXQo=