Bug 171930 - LayoutTest/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-idl.html is flaky
Summary: LayoutTest/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-idl.html ...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-05-10 10:10 PDT by Matt Lewis
Modified: 2017-06-01 10:03 PDT (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-05-10 10:10:08 PDT
The test imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-idl.html is a flaky failure on Sierra Debug and is consistently failing on El Capitan and iOS simulator.

test was added in https://trac.webkit.org/changeset/216537/webkit

History:
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-idl.html

build:
https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/917
https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r216581%20(917)/results.html

diff:
--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-idl-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-idl-actual.txt
@@ -1,7 +1,16 @@
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Can only call RTCPeerConnection.createOffer on instances of RTCPeerConnection
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Can only call RTCPeerConnection.createAnswer on instances of RTCPeerConnection
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Can only call RTCPeerConnection.addIceCandidate on instances of RTCPeerConnection
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Can only call RTCPeerConnection.getStats on instances of RTCPeerConnection
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Argument 1 ('description') to RTCPeerConnection.setLocalDescription must be an instance of RTCSessionDescription
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Argument 1 ('description') to RTCPeerConnection.setRemoteDescription must be an instance of RTCSessionDescription
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Not enough arguments
 Description
 
 This test verifies the availability of the RTCPeerConnection interface.
 
+
+Harness Error (FAIL), message = Not enough arguments
 
 PASS EventTarget interface: existence and properties of interface object 
 PASS EventTarget interface object length
Comment 1 Matt Lewis 2017-05-10 10:17:34 PDT
Marked test flaky in test expectations.
 https://trac.webkit.org/changeset/216594/webkit/
Comment 2 Matt Lewis 2017-06-01 09:42:16 PDT
While working on another group of test in the same grouping of imported/w3c/web-platform-tests/webrtc/ I have found this test is now failing every time on all WK2 platforms.