Bug 47727

Summary: [GTK] mathml flaky tests after adding SystemFonts to the theme
Product: WebKit Reporter: Alejandro G. Castro <alex>
Component: WebKitGTKAssignee: Martin Robinson <mrobinson>
Status: RESOLVED FIXED    
Severity: Normal CC: alex, eric, mrobinson, zan
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: PC   
OS: Linux   
URL: alex@milowski.com
Attachments:
Description Flags
Ensure STIX fonts in DRT setup none

Description Alejandro G. Castro 2010-10-15 10:51:35 PDT
After the commit fixing the fonts in the forms these tests started to be flaky, mostly in the debug bots.

mathml/presentation/fenced.xhtml
mathml/presentation/roots.xhtml
mathml/presentation/subsup.xhtml

http://trac.webkit.org/changeset/69818
Comment 1 Alex Milowski 2010-10-17 10:44:57 PDT
I believe bug 47774 has taken care of this.  Can you check again?
Comment 2 Martin Robinson 2010-10-17 11:57:28 PDT
As I understand it, the tests differed between the bots, so we may need some extra machinery in the DRT setup to ensure that STIX fonts load.
Comment 3 Alex Milowski 2010-10-17 11:59:32 PDT
We don't use the STIX fonts yet.  That has yet to be configured.  We'd need to setup a check/download step in the run-webkit-tests script.
Comment 4 Martin Robinson 2010-10-17 12:13:18 PDT
(In reply to comment #3)
> We don't use the STIX fonts yet.  That has yet to be configured.  We'd need to setup a check/download step in the run-webkit-tests script.

The MathML stylesheet specifies them if I understand correctly. I believe that some of the bots have them and some of them don't or they have different versions.
Comment 5 Alex Milowski 2010-10-17 12:32:29 PDT
OK.  I understand the issue now.  We want them all to have it.  I'd like the test infrastructure to guarantee this.
Comment 6 Alejandro G. Castro 2010-10-18 03:24:56 PDT
(In reply to comment #1)
> I believe bug 47774 has taken care of this.  Can you check again?

I've ran the tests locally and they still have issues with current results. I've checked also the STIX fonts in the bots a apparently the debug bots (32bits and 64bits) have it, do I have to look for some version or other specific information?


bb-webkit-32 ~ # fc-list | grep STIX
STIXIntegralsUp:style=Regular
STIXIntegralsSm:style=Regular
STIXSizeFourSym:style=Bold
STIXNonUnicode:style=Bold
STIXVariants:style=Regular
STIXIntegralsSm:style=Bold
STIXGeneral:style=Bold
STIXIntegralsUp:style=Bold
STIXGeneral:style=Italic
STIXVariants:style=Bold
STIXIntegralsUpD:style=Bold
STIXNonUnicode:style=Italic
STIXGeneral:style=Regular
STIXSizeTwoSym:style=Bold
STIXGeneral:style=Bold Italic
STIXNonUnicode:style=Regular
STIXNonUnicode:style=Bold Italic
STIXSizeOneSym:style=Regular
STIXSizeOneSym:style=Bold
STIXSizeFourSym:style=Regular
STIXIntegralsUpSm:style=Bold
STIXSizeTwoSym:style=Regular
STIXIntegralsD:style=Bold
STIXIntegralsUpD:style=Regular
STIXIntegralsD:style=Regular
STIXSizeThreeSym:style=Regular
STIXSizeFiveSym:style=Regular
STIXIntegralsUpSm:style=Regular
STIXSizeThreeSym:style=Bold


bb-webkit-64 ~ # fc-list | grep STIX
STIXIntegralsUp:style=Regular
STIXIntegralsSm:style=Regular
STIXSizeFourSym:style=Bold
STIXNonUnicode:style=Bold
STIXVariants:style=Regular
STIXIntegralsSm:style=Bold
STIXGeneral:style=Bold
STIXIntegralsUp:style=Bold
STIXGeneral:style=Italic
STIXVariants:style=Bold
STIXIntegralsUpD:style=Bold
STIXNonUnicode:style=Italic
STIXGeneral:style=Regular
STIXSizeTwoSym:style=Bold
STIXGeneral:style=Bold Italic
STIXNonUnicode:style=Regular
STIXNonUnicode:style=Bold Italic
STIXSizeOneSym:style=Regular
STIXSizeOneSym:style=Bold
STIXSizeFourSym:style=Regular
STIXIntegralsUpSm:style=Bold
STIXSizeTwoSym:style=Regular
STIXIntegralsD:style=Bold
STIXIntegralsUpD:style=Regular
STIXIntegralsD:style=Regular
STIXSizeThreeSym:style=Regular
STIXSizeFiveSym:style=Regular
STIXIntegralsUpSm:style=Regular
STIXSizeThreeSym:style=Bold
Comment 7 Alejandro G. Castro 2010-10-18 03:35:37 PDT
At this point there is a new mathml/presentation test that it is failing in the 32bots (debug and release) but it is not failing in the 64bits debug bot, at least once. I'm going to add it to the Skipped file until we find a solution:

mathml/presentation/fenced-mi.xhtml
Comment 8 Alex Milowski 2010-10-18 07:29:46 PDT
The tests are failing because the current results do not use the STIX fonts.  We need to make sure all the build bots have the STIX fonts.  This should get all sorted out shortly and we'll re-baseline the MathML tests with the STIX fonts.
Comment 9 Martin Robinson 2010-10-18 17:33:21 PDT
Created attachment 71105 [details]
Ensure STIX fonts in DRT setup
Comment 10 Alex Milowski 2010-10-18 18:24:07 PDT
(In reply to comment #9)
> Created an attachment (id=71105) [details]
> Ensure STIX fonts in DRT setup

I've looked at these results and they look pretty good.  The issue with the glyph stacking for the absolute sign (vertical bar) and integral sign are some STIX/GTK issue we'll need to work on.  I've filed a bug for the absolute sign already.  These have to do with the interaction between the glyph stacking algorithm and the font metrics.
Comment 11 Alejandro G. Castro 2010-10-19 02:43:18 PDT
(In reply to comment #9)
> Created an attachment (id=71105) [details]
> Ensure STIX fonts in DRT setup

I've tested the patch locally running the mathml tests, the visual result look good but the expected results do not match. Apparently small pixel differences.
Comment 12 Gustavo Noronha (kov) 2010-10-21 11:52:36 PDT
Comment on attachment 71105 [details]
Ensure STIX fonts in DRT setup

Let's do it.
Comment 13 Martin Robinson 2010-10-21 12:12:01 PDT
Committed r70253: <http://trac.webkit.org/changeset/70253>
Comment 14 Alejandro G. Castro 2010-10-22 10:42:51 PDT
I'm afraid this did not fix the issue mathml/presentation tests are still flaky.
Comment 15 Alejandro G. Castro 2010-10-22 23:58:33 PDT
I'm skipping all the tests until we find the problem:

http://trac.webkit.org/changeset/70383
Comment 16 Alejandro G. Castro 2010-11-23 03:57:46 PST
Probably the fix in http://trac.webkit.org/changeset/72413 could solve this issue, we could try to unskip these tests to check it.
Comment 17 Alex Milowski 2010-11-23 08:57:13 PST
(In reply to comment #16)
> Probably the fix in http://trac.webkit.org/changeset/72413 could solve this issue, we could try to unskip these tests to check it.

That sounds like a good idea.  Is there any way to test this other than turning the test back on and waiting till things fail in the build bots?
Comment 18 Alejandro G. Castro 2010-11-24 04:04:47 PST
(In reply to comment #17)
> (In reply to comment #16)
> > Probably the fix in http://trac.webkit.org/changeset/72413 could solve this issue, we could try to unskip these tests to check it.
> 
> That sounds like a good idea.  Is there any way to test this other than turning the test back on and waiting till things fail in the build bots?

I'm afraid we can not 100% sure, I'm going to run the tests in a loop in my local machine and in case I can not reproduce it I'll unskip it.
Comment 19 Alejandro G. Castro 2010-11-24 07:39:30 PST
Unskipped, let's check if that works. http://trac.webkit.org/changeset/72670
Comment 20 Alejandro G. Castro 2010-11-24 09:39:32 PST
It did not fix the issue, I'm going to skip again and we have to check the issue. 

http://build.webkit.org/results/GTK Linux 64-bit Debug/r72674 (16327)/mathml/presentation/subsup-pretty-diff.html
Comment 21 Eric Seidel (no email) 2010-12-14 01:34:53 PST
Seems this should be closed?
Comment 22 Alejandro G. Castro 2010-12-14 02:34:51 PST
(In reply to comment #21)
> Seems this should be closed?

They are still in the Skipped file and flaky, so we still have to check the issue.
Comment 23 Eric Seidel (no email) 2010-12-14 15:16:02 PST
Attachment 71105 [details] was posted by a committer and has review+, assigning to Martin Robinson for commit.
Comment 24 Martin Robinson 2010-12-14 18:51:26 PST
Comitted as http://trac.webkit.org/changeset/70253
Comment 25 Zan Dobersek 2012-07-19 06:03:35 PDT
The tests required updated baselines, which was done in r122704[1]. The baselines are almost identical to those for Mac port, and with the tests now passing with no flakiness visible I've removed their expectations in r123096[2]. Closing the bug.


[1] - http://trac.webkit.org/changeset/122704
[2] - http://trac.webkit.org/changeset/123096