Bug 196112 - [ Mojave iOS Sim WK2] Layout Test imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html is a flaky failure
Summary: [ Mojave iOS Sim WK2] Layout Test imported/w3c/web-platform-tests/mathml/rela...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-03-21 14:46 PDT by Shawn Roberts
Modified: 2019-03-27 15:17 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Shawn Roberts 2019-03-21 14:46:08 PDT
The following layout test is flaky on Mojave, iOS SIM WK2

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Probable cause:

Test is very flaky, and appears to have been flaky since imported. Able to reproduce locally from the oldest version I can spade (r228049) and various versions up to and including current (r243314). Same Diff produced locally that is produced by the bots.

Reproduced with:

run-webkit-tests imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html --iterations 500 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Diff: 

https://build.webkit.org/results/Apple%20Mojave%20Release%20WK2%20(Tests)/r243277%20(3230)/imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic-diff.png
Comment 1 Shawn Roberts 2019-03-27 15:06:23 PDT
Two other layout tests from the same directory are failing as well.

imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-bold.html imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-double-struck.html 
imported/w3c/web-platform-tests/mathml/relations/css-styling/mathvariant-italic.html

Dashboard for all 3:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-bold.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-double-struck.html%20imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fmathvariant-italic.html

Dashboard for each tests only shows a few platforms being affected, but when attempting locally I can get it to fail on other platforms not seen on dashboard.
Comment 2 Radar WebKit Bug Importer 2019-03-27 15:07:51 PDT
<rdar://problem/49355276>
Comment 3 Shawn Roberts 2019-03-27 15:17:58 PDT
Marked flaky in https://trac.webkit.org/changeset/243566/webkit