171703 2017-05-04 17:56:58 -0700 [ Sierra Debug WK2] Layout Test webrtc/libwebrtc/descriptionGetters.html is flaky 2017-09-29 10:52:19 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=170709 InRadar P2 Normal --- 1 jlewis3 jlewis3 commit-queue ryanhaddad webkit-bug-importer youennf oldest_to_newest 1304919 0 jlewis3 2017-05-04 17:56:58 -0700 The test webrtc/libwebrtc/descriptionGetters.html is flaky on Sierra wk2 Debug. There was a change in changeset r215251 on the teston 4/11/2017 but the first failure was on 4/7/2017 History: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Flibwebrtc%2FdescriptionGetters.html Build log: https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/818 Diff: --- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/libwebrtc/descriptionGetters-expected.txt +++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/webrtc/libwebrtc/descriptionGetters-actual.txt @@ -1,3 +1,3 @@ -PASS description getters when changing description from video to video & data channel +FAIL description getters when changing description from video to video & data channel assert_equals: test 14 expected "v=0\r\no=- 8753924785808259018 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE video\r\na=msid-semantic: WMS b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\nm=video 61530 UDP/TLS/RTP/SAVPF 96 98 99 97 100\r\nc=IN IP4 17.202.88.219\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=candidate:998840395 1 udp 2122260223 17.202.88.219 61530 typ host generation 0 network-id 1 network-cost 50\r\na=ice-ufrag:qqD6\r\na=ice-pwd:RF2vPRr1xgERO0LnO/FPWc12\r\na=fingerprint:sha-256 0E:A9:35:59:0D:9C:3A:47:9B:8E:9C:78:31:2A:F7:A7:5F:22:28:67:16:F8:CF:80:77:0E:B8:60:18:73:C2:F9\r\na=setup:actpass\r\na=mid:video\r\na=extmap:2 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:3 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:4 urn:3gpp:video-orientation\r\na=extmap:5 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 red/90000\r\na=rtpmap:98 ulpfec/90000\r\na=rtpmap:99 H264/90000\r\na=rtcp-fb:99 ccm fir\r\na=rtcp-fb:99 nack\r\na=rtcp-fb:99 nack pli\r\na=rtcp-fb:99 goog-remb\r\na=rtcp-fb:99 transport-cc\r\na=fmtp:99 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:100 rtx/90000\r\na=fmtp:100 apt=99\r\na=ssrc-group:FID 1624265679 1637652785\r\na=ssrc:1624265679 cname:8zp4f4S054Vz02Zj\r\na=ssrc:1624265679 msid:b0882ffc-8fd3-4947-9cd7-4a437e3ce559 3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1624265679 mslabel:b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\na=ssrc:1624265679 label:3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1637652785 cname:8zp4f4S054Vz02Zj\r\na=ssrc:1637652785 msid:b0882ffc-8fd3-4947-9cd7-4a437e3ce559 3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1637652785 mslabel:b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\na=ssrc:1637652785 label:3213e84d-763b-4a13-b3db-3b0e1a34537b\r\n" but got "v=0\r\no=- 8753924785808259018 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE video\r\na=msid-semantic: WMS b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\nm=video 9 UDP/TLS/RTP/SAVPF 96 98 99 97 100\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:qqD6\r\na=ice-pwd:RF2vPRr1xgERO0LnO/FPWc12\r\na=fingerprint:sha-256 0E:A9:35:59:0D:9C:3A:47:9B:8E:9C:78:31:2A:F7:A7:5F:22:28:67:16:F8:CF:80:77:0E:B8:60:18:73:C2:F9\r\na=setup:actpass\r\na=mid:video\r\na=extmap:2 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:3 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:4 urn:3gpp:video-orientation\r\na=extmap:5 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 red/90000\r\na=rtpmap:98 ulpfec/90000\r\na=rtpmap:99 H264/90000\r\na=rtcp-fb:99 ccm fir\r\na=rtcp-fb:99 nack\r\na=rtcp-fb:99 nack pli\r\na=rtcp-fb:99 goog-remb\r\na=rtcp-fb:99 transport-cc\r\na=fmtp:99 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:100 rtx/90000\r\na=fmtp:100 apt=99\r\na=ssrc-group:FID 1624265679 1637652785\r\na=ssrc:1624265679 cname:8zp4f4S054Vz02Zj\r\na=ssrc:1624265679 msid:b0882ffc-8fd3-4947-9cd7-4a437e3ce559 3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1624265679 mslabel:b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\na=ssrc:1624265679 label:3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1637652785 cname:8zp4f4S054Vz02Zj\r\na=ssrc:1637652785 msid:b0882ffc-8fd3-4947-9cd7-4a437e3ce559 3213e84d-763b-4a13-b3db-3b0e1a34537b\r\na=ssrc:1637652785 mslabel:b0882ffc-8fd3-4947-9cd7-4a437e3ce559\r\na=ssrc:1637652785 label:3213e84d-763b-4a13-b3db-3b0e1a34537b\r\n" 1304923 1 309120 jlewis3 2017-05-04 18:04:52 -0700 Created attachment 309120 Mark test as flaky 1304925 2 309120 ryanhaddad 2017-05-04 18:06:02 -0700 Comment on attachment 309120 Mark test as flaky Clearing flags on attachment: 309120 Committed r216222: <http://trac.webkit.org/changeset/216222> 1305011 3 webkit-bug-importer 2017-05-04 22:35:21 -0700 <rdar://problem/32008597> 1320872 4 jlewis3 2017-06-19 15:48:20 -0700 This test has started to become flaky on macOS El Capitan WK2 as well: https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r218503%20(1821)/results.html Adjusted the test expectations: https://trac.webkit.org/changeset/218514/webkit 1354587 5 322208 youennf 2017-09-29 10:47:05 -0700 Created attachment 322208 Patch 309120 2017-05-04 18:04:52 -0700 2017-05-04 18:06:17 -0700 Mark test as flaky bug-171703-20170504180452.patch text/plain 1381 jlewis3 U3VidmVyc2lvbiBSZXZpc2lvbjogMjE2MjIxCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggMGY1MjllMTgyNzQxY2IyY2M0NGRl MDcyZmRmMWFkMjI0MDY2YWJkOC4uMzUzMzBmZmFiZWYyYWNjYjk5YWU4YjdhMjJlMmMzMzVkMzA1 NTY2YyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEyIEBACisyMDE3LTA1LTA0ICBNYXR0IExld2lzICA8amxl d2lzM0BhcHBsZS5jb20+CisKKyAgICAgICAgTWFyayB3ZWJydGMvbGlid2VicnRjL2Rlc2NyaXB0 aW9uR2V0dGVycy5odG1sIGFzIGZsYWt5LgorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9y Zy9zaG93X2J1Zy5jZ2k/aWQ9MTcxNzAzCisKKyAgICAgICAgVW5yZXZpZXdlZCB0ZXN0IGdhcmRl bmluZy4KKworICAgICAgICAqIHBsYXRmb3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9uczoKKwog MjAxNy0wNS0wNCAgU2FpZCBBYm91LUhhbGxhd2EgIDxzYWJvdWhhbGxhd2FAYXBwbGUuY29tPgog CiAgICAgICAgIFJlbmFtZSB0ZXN0UnVubmVyLmRpc3BsYXlBbmRUcmFja1JlcGFpbnRzKCkgdG8g dGVzdFJ1bm5lci5kaXNwbGF5QW5kVHJhY2tSZXBhaW50cygpCmRpZmYgLS1naXQgYS9MYXlvdXRU ZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMgYi9MYXlvdXRUZXN0cy9wbGF0 Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMKaW5kZXggMjM5NzJlNDI5MzNlZDkwM2VlYTg0 OGEyNzNkZTc1NjliMGNiODFhMS4uMmJkNTJkNmM2NTA2NzZkMjNkMzdkZjJiODRkNmY2ZmYzMzli ZGNhNyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0 YXRpb25zCisrKyBiL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9u cwpAQCAtNjY3LDMgKzY2Nyw1IEBAIHdlYmtpdC5vcmcvYi8xNzE2MDUgaW1wb3J0ZWQvdzNjL3dl Yi1wbGF0Zm9ybS10ZXN0cy93ZWJydGMvcHJvbWlzZXMtY2FsbC5odG1sIFsKIHdlYmtpdC5vcmcv Yi8xNzE2MDUgaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy93ZWJydGMvZGF0YWNoYW5u ZWwtZW1wdHlzdHJpbmcuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCiAKIHdlYmtpdC5vcmcvYi8xNzE1 NTMgWyBSZWxlYXNlIF0gaHR0cC90ZXN0cy93ZWJzb2NrZXQvdGVzdHMvaHliaS9pbnNwZWN0b3Iv YmluYXJ5Lmh0bWwgWyBQYXNzIEZhaWx1cmUgXQorCit3ZWJraXQub3JnL2IvMTcyNzAzIFsgU2ll cnJhIERlYnVnIF0gd2VicnRjL2xpYndlYnJ0Yy9kZXNjcmlwdGlvbkdldHRlcnMuaHRtbCBbIFBh c3MgRmFpbHVyZSBdCg== 322208 2017-09-29 10:47:05 -0700 2017-09-29 10:52:19 -0700 Patch bug-171703-20170929194704.patch text/plain 1532 youennf U3VidmVyc2lvbiBSZXZpc2lvbjogMjIyNTYyCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggNjNmMDlkZTVkZGYyZjhlMDBlZGVj NGE1MDNlZWU3NTkwMWVjOGY1Yi4uOTBiYjJjNzZhYjgxNDlhZTE1YzdkZmY0YjQwZmMyN2VhZGYz Y2NiMiAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDE0IEBACisyMDE3LTA5LTI5ICBZb3Vlbm4gRmFibGV0ICA8 eW91ZW5uQGFwcGxlLmNvbT4KKworICAgICAgICBbIFNpZXJyYSBEZWJ1ZyBXSzJdIExheW91dCBU ZXN0IHdlYnJ0Yy9saWJ3ZWJydGMvZGVzY3JpcHRpb25HZXR0ZXJzLmh0bWwgaXMgZmxha3kKKyAg ICAgICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTE3MTcwMworICAg ICAgICA8cmRhcjovL3Byb2JsZW0vMzIwMDg1OTc+CisKKyAgICAgICAgVW5yZXZpZXdlZC4KKwor ICAgICAgICAqIHBsYXRmb3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9uczogUmVtb3ZpbmcgdGhl IGZsYWt5IGV4cGVjdGF0aW9uCisgICAgICAgIGFzIGRhc2hib2FyZCBzaG93cyB0aGlzIGlzIG5v IGxvbmdlciBmbGFreS4KKwogMjAxNy0wOS0yNyAgWW91ZW5uIEZhYmxldCAgPHlvdWVubkBhcHBs ZS5jb20+CiAKICAgICAgICAgQWRkIHF1b3RhIHRvIGNhY2hlIEFQSQpkaWZmIC0tZ2l0IGEvTGF5 b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zIGIvTGF5b3V0VGVzdHMv cGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zCmluZGV4IDA3YWI0NjhkMTNkZWNmOGRi NjNjZmViODRlMTc4MWI5NTZjMGE0YzguLjUzYjA0MTFiZTBjOTRhZmIyN2E5MzI1ZGI5M2FkNGJh MWQ4YWU0OTkgMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13azIvVGVzdEV4 cGVjdGF0aW9ucworKysgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3Rh dGlvbnMKQEAgLTY5MCw4ICs2OTAsNiBAQCB3ZWJraXQub3JnL2IvMTcwOTYwIGZhc3QvbWVkaWFz dHJlYW0vZ2V0VXNlck1lZGlhLXdlYmF1ZGlvLmh0bWwgWyBQYXNzIFRpbWVvdXQgXQogCiB3ZWJr aXQub3JnL2IvMTcxNTUzIFsgUmVsZWFzZSBdIGh0dHAvdGVzdHMvd2Vic29ja2V0L3Rlc3RzL2h5 YmkvaW5zcGVjdG9yL2JpbmFyeS5odG1sIFsgUGFzcyBGYWlsdXJlIF0KIAotd2Via2l0Lm9yZy9i LzE3MjcwMyAgd2VicnRjL2xpYndlYnJ0Yy9kZXNjcmlwdGlvbkdldHRlcnMuaHRtbCBbIFBhc3Mg RmFpbHVyZSBdCi0KIHdlYmtpdC5vcmcvYi8xNzE3NjMgWyBEZWJ1ZyBdIGNvbXBvc2l0aW5nL3Rp bGluZy9ub24tYWN0aXZlLXdpbmRvdy10aWxlcy1zaXplLmh0bWwgWyBQYXNzIEZhaWx1cmUgXQog CiB3ZWJraXQub3JnL2IvMTcxODM3IFsgRGVidWcgXSBodHRwL3Rlc3RzL3NlY3VyaXR5L3N0b3Jh Z2UtYmxvY2tpbmctbG9vc2VuZWQtcGx1Z2luLmh0bWwgWyBQYXNzIEZhaWx1cmUgXQo=