Bug 196112 – [ Mojave iOS Sim WK2] Layout Test imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html is a flaky failure

• Status: NEW
• Component: Tools / Tests

[Shawn Roberts]

The following layout test is flaky on Mojave, iOS SIM WK2

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Probable cause:

Test is very flaky, and appears to have been flaky since imported. Able to reproduce locally from the oldest version I can spade (r228049) and various versions up to and including current (r243314). Same Diff produced locally that is produced by the bots.

Reproduced with:

run-webkit-tests imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html --iterations 500 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Diff: 

https://build.webkit.org/results/Apple%20Mojave%20Release%20WK2%20(Tests)/r243277%20(3230)/imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic-diff.png

[Shawn Roberts]

Two other layout tests from the same directory are failing as well.

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-bold.html imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-double-struck.html 
imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Dashboard for all 3:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-bold.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-double-struck.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Dashboard for each tests only shows a few platforms being affected, but when attempting locally I can get it to fail on other platforms not seen on dashboard.

[Radar WebKit Bug Importer]

<rdar://problem/49355276>

[Shawn Roberts]

Marked flaky in https://trac.webkit.org/changeset/243566/webkit