Bug 208394 - [ macOS ] imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization.html is flaky failing
Summary: [ macOS ] imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-nor...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: DOM (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-28 15:00 PST by Jacob Uphoff
Modified: 2020-03-13 11:11 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jacob Uphoff 2020-02-28 15:00:43 PST
imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization.html

This test has been flaky failing on on Catalina and Mojave wk2 on release. 

Failure has been failing for all visible history.

History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fdom%2Fnodes%2FDocument-characterSet-normalization.html&limit=50000

Diff:

--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Name "UTF-8" has label "unicode-1-1-utf-8" (characterSet) 
 PASS Name "UTF-8" has label "unicode-1-1-utf-8" (inputEncoding) 
@@ -257,9 +259,9 @@
 PASS Name "ISO-8859-10" has label "csisolatin6" (characterSet) 
 PASS Name "ISO-8859-10" has label "csisolatin6" (inputEncoding) 
 PASS Name "ISO-8859-10" has label "csisolatin6" (charset) 
-PASS Name "ISO-8859-10" has label "iso-8859-10" (characterSet) 
-PASS Name "ISO-8859-10" has label "iso-8859-10" (inputEncoding) 
-PASS Name "ISO-8859-10" has label "iso-8859-10" (charset) 
+NOTRUN Name "ISO-8859-10" has label "iso-8859-10" (characterSet) 
+NOTRUN Name "ISO-8859-10" has label "iso-8859-10" (inputEncoding) 
+NOTRUN Name "ISO-8859-10" has label "iso-8859-10" (charset) 
 PASS Name "ISO-8859-10" has label "iso-ir-157" (characterSet) 
 PASS Name "ISO-8859-10" has label "iso-ir-157" (inputEncoding) 
 PASS Name "ISO-8859-10" has label "iso-ir-157" (charset)
Comment 1 Radar WebKit Bug Importer 2020-02-28 15:02:59 PST
<rdar://problem/59904827>
Comment 2 Jacob Uphoff 2020-02-28 16:05:00 PST
Set expectations here: https://trac.webkit.org/changeset/257664/webkit
Comment 3 Chris Dumez 2020-03-13 11:11:00 PDT
The diff seems to vary a bit, for e.g.:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/dom/nodes/Document-characterSet-normalization-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Name "UTF-8" has label "unicode-1-1-utf-8" (characterSet) 
 PASS Name "UTF-8" has label "unicode-1-1-utf-8" (inputEncoding) 
@@ -185,9 +187,9 @@
 PASS Name "ISO-8859-7" has label "elot_928" (characterSet) 
 PASS Name "ISO-8859-7" has label "elot_928" (inputEncoding) 
 PASS Name "ISO-8859-7" has label "elot_928" (charset) 
-PASS Name "ISO-8859-7" has label "greek" (characterSet) 
-PASS Name "ISO-8859-7" has label "greek" (inputEncoding) 
-PASS Name "ISO-8859-7" has label "greek" (charset) 
+NOTRUN Name "ISO-8859-7" has label "greek" (characterSet) 
+NOTRUN Name "ISO-8859-7" has label "greek" (inputEncoding) 
+NOTRUN Name "ISO-8859-7" has label "greek" (charset) 
 PASS Name "ISO-8859-7" has label "greek8" (characterSet) 
 PASS Name "ISO-8859-7" has label "greek8" (inputEncoding) 
 PASS Name "ISO-8859-7" has label "greek8" (charset)