Bug 172821 - Multiple Layout Tests imported/w3c/web-platform-tests/webrtc/ are flaky
Summary: Multiple Layout Tests imported/w3c/web-platform-tests/webrtc/ are flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2017-06-01 10:02 PDT by Matt Lewis
Modified: 2017-08-29 15:53 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-01 10:02:57 PDT
Multiple imported/w3c/web-platform-tests/webrtc test are flaky failures:
  imported/w3c/web-platform-tests/webrtc/RTCDataChannel-id.html
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-addIceCandidate.html
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createDataChannel.html
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription.html

These test consistently fail with each other. They may be related to the bug in the see also section.
They were not imported together however. They were imported with:
  https://trac.webkit.org/changeset/217225/webkit
  https://trac.webkit.org/changeset/216537/webkit
and  and seem to have been failing intermittently since added

https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r217653%20(1457)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/builds/1457

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCDataChannel-id.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-addIceCandidate.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-createDataChannel.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-createDataChannel.html
Comment 1 Radar WebKit Bug Importer 2017-06-02 17:11:15 PDT
<rdar://problem/32548722>
Comment 2 Ryan Haddad 2017-06-22 13:38:43 PDT
This is still happening:
https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218712%20(2579)/results.html

  imported/w3c/web-platform-tests/webrtc/RTCDataChannel-id.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-addIceCandidate.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createAnswer.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createDataChannel.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-createOffer.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-onnegotiationneeded.html [ Failure ]
  imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription.html [ Failure ]