RESOLVED WONTFIX 82122
[Chromium] LayoutTests: css3/selector3/xml tests are flaky / have wrong expectations on Snow Leopard 
https://bugs.webkit.org/show_bug.cgi?id=82122
Summary [Chromium] LayoutTests: css3/selector3/xml tests are flaky / have wrong expec...
Pavel Feldman
Reported 2012-03-24 01:43:05 PDT
At first it seemed like the expectations dependency graph glitch, but I saw more and more = TEXT results as I was marking tests as SNOWLEOPARD = TEXT in the expectations. Could they actually be flaky?
Attachments
Add attachment proposed patch, testcase, etc.
Ojan Vafai
Comment 1 2012-03-26 11:45:39 PDT
Looks like ~120 of the css3/selectors3/xml tests are flaky. The text dump in some cases has two extra height==0, anonymous blocks that have empty RenderText's in them.
Kenneth Russell
Comment 2 2012-08-23 15:25:59 PDT
These tests are failing in the same way on the Chromium 10.7 debug bot, e.g.: http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7%20%28dbg%29/builds/71 Though interestingly not on the 10.7 release bot, e.g.: http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7/builds/10973 Why would these differences in the render tree be occurring mainly in debug mode? I'm going to generalize these expected results from "SNOWLEOPARD" to "MAC". Simply adding "LION" seems like the wrong approach since we might add a Mountain Lion bot soon.
Kenneth Russell
Comment 3 2012-08-23 15:37:10 PDT
Committed r126487: <http://trac.webkit.org/changeset/126487>
Ojan Vafai
Comment 4 2012-08-23 16:06:32 PDT
Could we restrict these lines to DEBUG only? They don't seem to fail on release.
Kenneth Russell
Comment 5 2012-08-23 18:34:10 PDT
Yes, we could definitely tighten up the test expectations. All of the tests fail only on the debug bots except the following two: css3/selectors3/xml/css3-modsel-101.xml fails on 10.6 Release but passes (with occasional flake) on 10.6 (dbg) css3/selectors3/xml/css3-modsel-124b.xml fails on 10.6 Release but apparently passes on 10.6 (dbg) Let me try to update the expectations now.
Kenneth Russell
Comment 6 2012-08-23 20:01:19 PDT
Committed r126529: <http://trac.webkit.org/changeset/126529>
Ojan Vafai
Comment 7 2012-08-23 20:30:21 PDT
Thanks! This way we at least have test coverage for these tests in release.
Stephen Chenney
Comment 8 2013-04-09 17:05:48 PDT
Marked LayoutTest bugs, bugs with Chromium IDs, and some others as WontFix. Test failure bugs still are trackable via TestExpectations or disabled unit tests.
Note You need to log in before you can comment on or make changes to this bug.