Bug 202960 – [ iOS13 ] Layout test imported/w3c/web-platform-tests/html/dom/idlharness.https.html is consistently Failing

• Status: RESOLVED
• Resolution: FIXED
• Component: Tools / Tests

[Russell Epstein]

The following layout test is failing consistently on iOS 13:

imported/w3c/web-platform-tests/html/dom/idlharness.https.html

This test was previously crashing. The crash was resolved in r251057, uncovering that the test is constantly failing.

Steps to Reproduce:

The following command results in crashes before r251057, and failures on r251057 and forward:
run-webkit-tests --ios-simulator --no-retry imported/w3c/web-platform-tests/html/dom/idlharness.https.html --iter 20

Test History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fdom%2Fidlharness.https.html&platform=ios

Diff:

--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.https-actual.txt
@@ -1,3 +1,5 @@
+CONSOLE MESSAGE: WebSocket network error: The operation couldn’t be completed. (kCFErrorDomainCFNetwork error 2.)
+CONSOLE MESSAGE: WebSocket network error: The operation couldn’t be completed. (kCFErrorDomainCFNetwork error 2.)
 HTML IDL tests
 
 
@@ -123,7 +125,7 @@
 FAIL HTMLElement interface: attribute accessKeyLabel assert_true: The prototype object must have a property "accessKeyLabel" expected true got false
 PASS HTMLElement interface: attribute draggable 
 PASS HTMLElement interface: attribute spellcheck 
-FAIL HTMLElement interface: attribute autocapitalize assert_true: The prototype object must have a property "autocapitalize" expected true got false
+PASS HTMLElement interface: attribute autocapitalize 
 PASS HTMLElement interface: attribute innerText 
 FAIL HTMLElement interface: operation attachInternals() assert_own_property: interface prototype object missing non-static operation expected property "attachInternals" missing
 PASS HTMLElement interface: attribute onabort 
@@ -213,7 +215,7 @@
 FAIL HTMLElement interface: document.createElement("noscript") must inherit property "accessKeyLabel" with the proper type assert_inherits: property "accessKeyLabel" not found in prototype chain
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "draggable" with the proper type 
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "spellcheck" with the proper type 
-FAIL HTMLElement interface: document.createElement("noscript") must inherit property "autocapitalize" with the proper type assert_inherits: property "autocapitalize" not found in prototype chain
+PASS HTMLElement interface: document.createElement("noscript") must inherit property "autocapitalize" with the proper type 
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "innerText" with the proper type 
 FAIL HTMLElement interface: document.createElement("noscript") must inherit property "attachInternals()" with the proper type assert_inherits: property "attachInternals" not found in prototype chain
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "onabort" with the proper type 
@@ -1248,13 +1250,9 @@
 PASS AudioTrack interface: existence and properties of interface prototype object's "constructor" property 
 PASS AudioTrack interface: existence and properties of interface prototype object's @@unscopables property 
 PASS AudioTrack interface: attribute id 
-FAIL AudioTrack interface: attribute kind assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function kind() {
-    [native code]
-}"
+PASS AudioTrack interface: attribute kind 
 PASS AudioTrack interface: attribute label 
-FAIL AudioTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS AudioTrack interface: attribute language 
 PASS AudioTrack interface: attribute enabled 
 PASS VideoTrackList interface: existence and properties of interface object 
 PASS VideoTrackList interface object length 
@@ -1275,13 +1273,9 @@
 PASS VideoTrack interface: existence and properties of interface prototype object's "constructor" property 
 PASS VideoTrack interface: existence and properties of interface prototype object's @@unscopables property 
 PASS VideoTrack interface: attribute id 
-FAIL VideoTrack interface: attribute kind assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function kind() {
-    [native code]
-}"
+PASS VideoTrack interface: attribute kind 
 PASS VideoTrack interface: attribute label 
-FAIL VideoTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS VideoTrack interface: attribute language 
 PASS VideoTrack interface: attribute selected 
 PASS TextTrackList interface: existence and properties of interface object 
 PASS TextTrackList interface object length 
@@ -1312,9 +1306,7 @@
     [native code]
 }"
 PASS TextTrack interface: attribute label 
-FAIL TextTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS TextTrack interface: attribute language 
 PASS TextTrack interface: attribute id 
 PASS TextTrack interface: attribute inBandMetadataTrackDispatchType 
 PASS TextTrack interface: attribute mode

[Radar WebKit Bug Importer]

<rdar://problem/56267775>

[Russell Epstein]

Updated TestExpectations in r251107

[Chris Dumez]

(In reply to Russell Epstein from comment #2)
> Updated TestExpectations in r251107

This needs a platform-specific baseline. Updating TestExpectations is definitely not the right thing to do here..

[Chris Dumez]

Committed r251109: <https://trac.webkit.org/changeset/251109>