Bug 202960 - [ iOS13 ] Layout test imported/w3c/web-platform-tests/html/dom/idlharness.https.html is consistently Failing
Summary: [ iOS13 ] Layout test imported/w3c/web-platform-tests/html/dom/idlharness.htt...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-10-14 15:50 PDT by Russell Epstein
Modified: 2019-10-14 16:33 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Russell Epstein 2019-10-14 15:50:46 PDT
The following layout test is failing consistently on iOS 13:

imported/w3c/web-platform-tests/html/dom/idlharness.https.html

This test was previously crashing. The crash was resolved in r251057, uncovering that the test is constantly failing.

Steps to Reproduce:

The following command results in crashes before r251057, and failures on r251057 and forward:
run-webkit-tests --ios-simulator --no-retry imported/w3c/web-platform-tests/html/dom/idlharness.https.html --iter 20

Test History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fdom%2Fidlharness.https.html&platform=ios

Diff:

--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.https-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.https-actual.txt
@@ -1,3 +1,5 @@
+CONSOLE MESSAGE: WebSocket network error: The operation couldn’t be completed. (kCFErrorDomainCFNetwork error 2.)
+CONSOLE MESSAGE: WebSocket network error: The operation couldn’t be completed. (kCFErrorDomainCFNetwork error 2.)
 HTML IDL tests
 
 
@@ -123,7 +125,7 @@
 FAIL HTMLElement interface: attribute accessKeyLabel assert_true: The prototype object must have a property "accessKeyLabel" expected true got false
 PASS HTMLElement interface: attribute draggable 
 PASS HTMLElement interface: attribute spellcheck 
-FAIL HTMLElement interface: attribute autocapitalize assert_true: The prototype object must have a property "autocapitalize" expected true got false
+PASS HTMLElement interface: attribute autocapitalize 
 PASS HTMLElement interface: attribute innerText 
 FAIL HTMLElement interface: operation attachInternals() assert_own_property: interface prototype object missing non-static operation expected property "attachInternals" missing
 PASS HTMLElement interface: attribute onabort 
@@ -213,7 +215,7 @@
 FAIL HTMLElement interface: document.createElement("noscript") must inherit property "accessKeyLabel" with the proper type assert_inherits: property "accessKeyLabel" not found in prototype chain
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "draggable" with the proper type 
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "spellcheck" with the proper type 
-FAIL HTMLElement interface: document.createElement("noscript") must inherit property "autocapitalize" with the proper type assert_inherits: property "autocapitalize" not found in prototype chain
+PASS HTMLElement interface: document.createElement("noscript") must inherit property "autocapitalize" with the proper type 
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "innerText" with the proper type 
 FAIL HTMLElement interface: document.createElement("noscript") must inherit property "attachInternals()" with the proper type assert_inherits: property "attachInternals" not found in prototype chain
 PASS HTMLElement interface: document.createElement("noscript") must inherit property "onabort" with the proper type 
@@ -1248,13 +1250,9 @@
 PASS AudioTrack interface: existence and properties of interface prototype object's "constructor" property 
 PASS AudioTrack interface: existence and properties of interface prototype object's @@unscopables property 
 PASS AudioTrack interface: attribute id 
-FAIL AudioTrack interface: attribute kind assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function kind() {
-    [native code]
-}"
+PASS AudioTrack interface: attribute kind 
 PASS AudioTrack interface: attribute label 
-FAIL AudioTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS AudioTrack interface: attribute language 
 PASS AudioTrack interface: attribute enabled 
 PASS VideoTrackList interface: existence and properties of interface object 
 PASS VideoTrackList interface object length 
@@ -1275,13 +1273,9 @@
 PASS VideoTrack interface: existence and properties of interface prototype object's "constructor" property 
 PASS VideoTrack interface: existence and properties of interface prototype object's @@unscopables property 
 PASS VideoTrack interface: attribute id 
-FAIL VideoTrack interface: attribute kind assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function kind() {
-    [native code]
-}"
+PASS VideoTrack interface: attribute kind 
 PASS VideoTrack interface: attribute label 
-FAIL VideoTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS VideoTrack interface: attribute language 
 PASS VideoTrack interface: attribute selected 
 PASS TextTrackList interface: existence and properties of interface object 
 PASS TextTrackList interface object length 
@@ -1312,9 +1306,7 @@
     [native code]
 }"
 PASS TextTrack interface: attribute label 
-FAIL TextTrack interface: attribute language assert_equals: setter must be undefined for readonly attributes expected (undefined) undefined but got (function) function "function language() {
-    [native code]
-}"
+PASS TextTrack interface: attribute language 
 PASS TextTrack interface: attribute id 
 PASS TextTrack interface: attribute inBandMetadataTrackDispatchType 
 PASS TextTrack interface: attribute mode
Comment 1 Radar WebKit Bug Importer 2019-10-14 15:51:13 PDT
<rdar://problem/56267775>
Comment 2 Russell Epstein 2019-10-14 15:57:40 PDT
Updated TestExpectations in r251107
Comment 3 Chris Dumez 2019-10-14 16:06:25 PDT
(In reply to Russell Epstein from comment #2)
> Updated TestExpectations in r251107

This needs a platform-specific baseline. Updating TestExpectations is definitely not the right thing to do here..
Comment 4 Chris Dumez 2019-10-14 16:33:39 PDT
Committed r251109: <https://trac.webkit.org/changeset/251109>