REGRESSION(iOS 14): 2 imported/w3c/web-platform-tests/mathml/ tests are constant failures

• Component: New Bugs
• Status: RESOLVED FIXED

[Hector Lopez]

imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html
imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html

Tests are a constant failure according to history on iOS. First occurrence of failures coincides with testing from iOS 13 to iOS 14. Of note, tests were re-synced on https://trac.webkit.org/changeset/267531/webkit

History:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fpadding-border-margin%2Fborder-002.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fhtml5-tree%2Fdynamic-childlist-001.html&platform=ios

Diff imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html:

--- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002-actual.txt
@@ -1,8 +1,8 @@
 
 PASS Border properties on maction
 PASS Border properties on maction (rtl)
-FAIL Border properties on menclose assert_approx_equals: bottom border expected 60 +/- 1 but got -4.1875
-FAIL Border properties on menclose (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -4.1875
+FAIL Border properties on menclose assert_approx_equals: bottom border expected 60 +/- 1 but got -4.171875
+FAIL Border properties on menclose (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -4.171875
 FAIL Border properties on merror assert_approx_equals: element width expected 70 +/- 1 but got 72
 FAIL Border properties on merror (rtl) assert_approx_equals: element width expected 70 +/- 1 but got 72
 FAIL Border properties on mfrac assert_approx_equals: left border expected 30 +/- 1 but got 0
@@ -17,8 +17,8 @@
 PASS Border properties on mo (rtl)
 FAIL Border properties on mover assert_approx_equals: left border expected 30 +/- 1 but got 0
 FAIL Border properties on mover (rtl) assert_approx_equals: left border expected 30 +/- 1 but got 0
-FAIL Border properties on mpadded assert_approx_equals: bottom border expected 60 +/- 1 but got -0.21875
-FAIL Border properties on mpadded (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -0.21875
+FAIL Border properties on mpadded assert_approx_equals: bottom border expected 60 +/- 1 but got -0.203125
+FAIL Border properties on mpadded (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -0.203125
 PASS Border properties on mphantom
 PASS Border properties on mphantom (rtl)
 FAIL Border properties on mroot assert_approx_equals: left border expected 30 +/- 1 but got 0
@@ -28,8 +28,8 @@
 PASS Border properties on ms
 PASS Border properties on ms (rtl)
 FAIL Border properties on mspace assert_approx_equals: left/right border expected 70 +/- 1 but got 0
-FAIL Border properties on msqrt assert_approx_equals: bottom border expected 60 +/- 1 but got -10.71875
-FAIL Border properties on msqrt (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -10.71875
+FAIL Border properties on msqrt assert_approx_equals: bottom border expected 60 +/- 1 but got -10.703125
+FAIL Border properties on msqrt (rtl) assert_approx_equals: bottom border expected 60 +/- 1 but got -10.703125
 PASS Border properties on mstyle
 PASS Border properties on mstyle (rtl)
 FAIL Border properties on msub assert_approx_equals: left border expected 30 +/- 1 but got 0

Diff imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html:

--- /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001-actual.txt
@@ -31,7 +31,7 @@
 FAIL Removing child from valid mroot assert_approx_equals: inline position (child 0) expected 0 +/- 1 but got 20.40625
 FAIL Adding child to valid mroot assert_approx_equals: inline position (child 0) expected 0 +/- 1 but got 20.40625
 PASS Removing extra child from mroot
-FAIL Removing children from msqrt assert_approx_equals: block size expected 19.71875 +/- 1 but got 31.765625
+FAIL Removing children from msqrt assert_approx_equals: block size expected 19.703125 +/- 1 but got 31.765625
 PASS Adding children to msqrt
 PASS Removing children from mpadded
 PASS Adding children to mpadded

[Radar WebKit Bug Importer]

<rdar://problem/69905072>

[Hector Lopez]

Test expectations while investigated:

https://trac.webkit.org/changeset/267913/webkit

[Hector Lopez]

Was able to reproduce with r267898:

rwt --root build-267898 imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html  --iterations 1000 --ios-simulator --exit-after-n-failures 3

Baseline search path: platform/ios-simulator-wk2 -> platform/ios-simulator -> platform/ios-wk2 -> platform/ios -> platform/wk2 -> generic

Running 1 test for iPhone SE running iOS

Running 1 WebKitTestRunnerApp.app.

[1/1000] imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html failed unexpectedly (text diff)
[2/1000] imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html failed unexpectedly (text diff)
[3/1000] imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html failed unexpectedly (text diff)
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (997 didn't run):


Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html [ Failure ]

rwt --root build-267898 imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html  --iterations 1000 --ios-simulator --exit-after-n-failures 3

Baseline search path: platform/ios-simulator-wk2 -> platform/ios-simulator -> platform/ios-wk2 -> platform/ios -> platform/wk2 -> generic

Running 1 test for iPhone SE running iOS

Running 1 WebKitTestRunnerApp.app.

[1/1000] imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html failed unexpectedly (text diff)
[2/1000] imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html failed unexpectedly (text diff)
[3/1000] imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html failed unexpectedly (text diff)
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (997 didn't run):


Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-001.html [ Failure ]

[Karl Rackler]

Test: imported/w3c/web-platform-tests/mathml/relations/css-styling/padding-border-margin/border-002.html
I have marked in iOS Simulator as failing while this issue is investigated.
https://trac.webkit.org/changeset/268840/webkit

[Cameron McCormack (:heycam)]

Re-enabling border-002.html in bug 227520.

[Nikos Mouchtaris]

Re-enabled dynamic-childlist-001.html in https://bugs.webkit.org/show_bug.cgi?id=232504.