Bug 82122 - [Chromium] LayoutTests: css3/selector3/xml tests are flaky / have wrong expectations on Snow Leopard
Summary: [Chromium] LayoutTests: css3/selector3/xml tests are flaky / have wrong expec...
Status: RESOLVED WONTFIX
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Ojan Vafai
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-03-24 01:43 PDT by Pavel Feldman
Modified: 2013-04-09 17:05 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Pavel Feldman 2012-03-24 01:43:05 PDT
At first it seemed like the expectations dependency graph glitch, but I saw more and more = TEXT results as I was marking tests as SNOWLEOPARD = TEXT in the expectations. Could they actually be flaky?
Comment 1 Ojan Vafai 2012-03-26 11:45:39 PDT
Looks like ~120 of the css3/selectors3/xml tests are flaky. The text dump in some cases has two extra height==0, anonymous blocks that have empty RenderText's in them.
Comment 2 Kenneth Russell 2012-08-23 15:25:59 PDT
These tests are failing in the same way on the Chromium 10.7 debug bot, e.g.:

http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7%20%28dbg%29/builds/71

Though interestingly not on the 10.7 release bot, e.g.:

http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7/builds/10973

Why would these differences in the render tree be occurring mainly in debug mode?

I'm going to generalize these expected results from "SNOWLEOPARD" to "MAC". Simply adding "LION" seems like the wrong approach since we might add a Mountain Lion bot soon.
Comment 3 Kenneth Russell 2012-08-23 15:37:10 PDT
Committed r126487: <http://trac.webkit.org/changeset/126487>
Comment 4 Ojan Vafai 2012-08-23 16:06:32 PDT
Could we restrict these lines to DEBUG only? They don't seem to fail on release.
Comment 5 Kenneth Russell 2012-08-23 18:34:10 PDT
Yes, we could definitely tighten up the test expectations. All of the tests fail only on the debug bots except the following two:

css3/selectors3/xml/css3-modsel-101.xml fails on 10.6 Release but passes (with occasional flake) on 10.6 (dbg)
css3/selectors3/xml/css3-modsel-124b.xml fails on 10.6 Release but apparently passes on 10.6 (dbg)

Let me try to update the expectations now.
Comment 6 Kenneth Russell 2012-08-23 20:01:19 PDT
Committed r126529: <http://trac.webkit.org/changeset/126529>
Comment 7 Ojan Vafai 2012-08-23 20:30:21 PDT
Thanks! This way we at least have test coverage for these tests in release.
Comment 8 Stephen Chenney 2013-04-09 17:05:48 PDT
Marked LayoutTest bugs, bugs with Chromium IDs, and some others as WontFix. Test failure bugs still are trackable via TestExpectations or disabled unit tests.