Bug 196112

Summary: [ Mojave iOS Sim WK2] Layout Test imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html is a flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: fred.wang, lforschler, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Shawn Roberts 2019-03-21 14:46:08 PDT
The following layout test is flaky on Mojave, iOS SIM WK2

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Probable cause:

Test is very flaky, and appears to have been flaky since imported. Able to reproduce locally from the oldest version I can spade (r228049) and various versions up to and including current (r243314). Same Diff produced locally that is produced by the bots.

Reproduced with:

run-webkit-tests imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html --iterations 500 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Diff: 

https://build.webkit.org/results/Apple%20Mojave%20Release%20WK2%20(Tests)/r243277%20(3230)/imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic-diff.png
Comment 1 Shawn Roberts 2019-03-27 15:06:23 PDT
Two other layout tests from the same directory are failing as well.

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-bold.html imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-double-struck.html 
imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Dashboard for all 3:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-bold.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-double-struck.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Dashboard for each tests only shows a few platforms being affected, but when attempting locally I can get it to fail on other platforms not seen on dashboard.
Comment 2 Radar WebKit Bug Importer 2019-03-27 15:07:51 PDT
<rdar://problem/49355276>
Comment 3 Shawn Roberts 2019-03-27 15:17:58 PDT
Marked flaky in https://trac.webkit.org/changeset/243566/webkit