170818 2017-04-13 12:16:47 -0700 LayoutTest imported/w3c/web-platform-tests/webrtc/rtcpeerconnection/setRemoteDescription.html is a flaky failure 2017-06-01 10:04:00 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=172521 https://bugs.webkit.org/show_bug.cgi?id=172821 P2 Normal --- 1 ryanhaddad jlewis3 jlewis3 youennf oldest_to_newest 1297078 0 ryanhaddad 2017-04-13 12:16:47 -0700 LayoutTest imported/w3c/web-platform-tests/webrtc/rtcpeerconnection/setRemoteDescription.html is a flaky failure https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r215322%20(501)/results.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2Frtcpeerconnection%2FsetRemoteDescription.html --- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/rtcpeerconnection/setRemoteDescription-expected.txt +++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/rtcpeerconnection/setRemoteDescription-actual.txt @@ -1,3 +1,5 @@ -PASS Triggers onaddstream when called with a remote description and the MSID is parsed. +Harness Error (TIMEOUT), message = null +TIMEOUT Triggers onaddstream when called with a remote description and the MSID is parsed. Test timed out + 1303728 1 308836 jlewis3 2017-05-02 11:15:45 -0700 Created attachment 308836 Mark test as flaky 1303729 2 jlewis3 2017-05-02 11:16:23 -0700 (In reply to Matt Lewis from comment #1) > Created attachment 308836 [details] > Patch Added to test expectations. 1303739 3 308836 ryanhaddad 2017-05-02 11:45:22 -0700 Comment on attachment 308836 Mark test as flaky Clearing flags on attachment: 308836 Committed r216081: <http://trac.webkit.org/changeset/216081> 1308846 4 jlewis3 2017-05-15 16:21:35 -0700 This test is consistently failing with these other tests: imported/w3c/web-platform-tests/webrtc/RTCDataChannel-id.html Diff: --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCDataChannel-id-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCDataChannel-id-actual.txt @@ -1,4 +1,4 @@ -FAIL DTLS client uses odd data channel IDs assert_equals: id expected 1 but got 0 -FAIL DTLS server uses even data channel IDs assert_not_equals: got disallowed value null +FAIL DTLS client uses odd data channel IDs promise_test: Unhandled rejection with value: object "TypeError: null is not an object (evaluating 'pc.localDescription.sdp')" +FAIL DTLS server uses even data channel IDs promise_test: Unhandled rejection with value: object "TypeError: null is not an object (evaluating 'pc.localDescription.sdp')" imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createDataChannel.html Diff: --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createDataChannel-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createDataChannel-actual.txt @@ -22,7 +22,7 @@ PASS createDataChannel with id -1 PASS createDataChannel with id 0 PASS createDataChannel with id 1 -FAIL createDataChannel with id 65534 The operation is not supported. +PASS createDataChannel with id 65534 PASS createDataChannel with id 65535 PASS createDataChannel with id 65536 FAIL createDataChannel with priority "high" assert_equals: expected (string) "high" but got (undefined) undefined imported/w3c/web-platform-tests/webrtc/getstats.html Diff: --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/getstats-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/getstats-actual.txt @@ -1,5 +1,5 @@ -FAIL Can get stats from a basic WebRTC call. assert_unreached: Error: assert_not_equals: Did not find peer-connection stats got disallowed value null: Reached unreachable code +FAIL Can get stats from a basic WebRTC call. assert_unreached: Error TypeError: Argument 1 ('description') to RTCPeerConnection.setRemoteDescription must be an instance of RTCSessionDescription happened at step Set remote description at second Reached unreachable code Retrieved stats info 308836 2017-05-02 11:15:45 -0700 2017-05-02 11:45:41 -0700 Mark test as flaky bug-170818-20170502111544.patch text/plain 1440 jlewis3 U3VidmVyc2lvbiBSZXZpc2lvbjogMjE2MDc5CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggYmIyNGQwNWI1OTYwZmE0ZTIzYzkx MDI5NDg0OWNhMTNmMTgzY2NlNC4uMTIxYmYwNmQzOWI2OGY3OGRiYjVhN2FkMDE3NDg5YWRkNmE0 ZmNmZiAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEyIEBACisyMDE3LTA1LTAyICBNYXR0IExld2lzICA8amxl d2lzM0BhcHBsZS5jb20+CisKKyAgICAgICAgTWFya2VkIHRlc3QgaW1wb3J0ZWQvdzNjL3dlYi1w bGF0Zm9ybS10ZXN0cy93ZWJydGMvcnRjcGVlcmNvbm5lY3Rpb24vc2V0UmVtb3RlRGVzY3JpcHRp b24uaHRtbCBhcyBmbGFreSBmYWlsdXJlLgorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9y Zy9zaG93X2J1Zy5jZ2k/aWQ9MTcwODE4CisKKyAgICAgICAgVW5yZXZpZXdlZCB0ZXN0IGdhcmRl bmluZy4KKworICAgICAgICAqIHBsYXRmb3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9uczoKKwog MjAxNy0wNS0wMiAgTXlsZXMgQy4gTWF4ZmllbGQgIDxtbWF4ZmllbGRAYXBwbGUuY29tPgogCiAg ICAgICAgIEZvbnQgTG9hZGluZyBBUEkgc3BlY2lmaWVzIGZvbnQgaXMgbG9hZGVkIGJ1dCBzaXpp bmcgb2YgZm9udCBhZnRlciBsb2FkIHJlcG9ydHMgaW5jb25zaXN0ZW50IHZhbHVlcwpkaWZmIC0t Z2l0IGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zIGIvTGF5 b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zCmluZGV4IGEyMWM3Yjg0 NzA2ZDFkNTAwMWI4ZmMwNzcwNWM0YWFmMjEyYzE4NWMuLjU1MWQ2MGRjMzI4ODg4MTY3NDdhNTc1 OWVjZThkYTM3Yzc0OGEzNjUgMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13 azIvVGVzdEV4cGVjdGF0aW9ucworKysgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rl c3RFeHBlY3RhdGlvbnMKQEAgLTY1NywzICs2NTcsNSBAQCB3ZWJraXQub3JnL2IvMTcwNjI5IFsg U2llcnJhIERlYnVnIF0gbWVtb3J5L21lbW9yeS1wcmVzc3VyZS1zaW11bGF0aW9uLmh0bWwgWyBQ YQogd2Via2l0Lm9yZy9iLzE3MDQ4NCBzd2lwZS9tYWluLWZyYW1lLXBpbm5pbmctcmVxdWlyZW1l bnQuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCiAKIHdlYmtpdC5vcmcvYi8xNzA5NjAgWyBTaWVycmEg XSBmYXN0L21lZGlhc3RyZWFtL2dldFVzZXJNZWRpYS13ZWJhdWRpby5odG1sIFsgUGFzcyBUaW1l b3V0IF0KKword2Via2l0Lm9yZy9iLzE3MDgxOCBpbXBvcnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRl c3RzL3dlYnJ0Yy9ydGNwZWVyY29ubmVjdGlvbi9zZXRSZW1vdGVEZXNjcmlwdGlvbi5odG1sIFsg UGFzcyBGYWlsdXJlIF0K