82122 2012-03-24 01:43:05 -0700 [Chromium] LayoutTests: css3/selector3/xml tests are flaky / have wrong expectations on Snow Leopard 2013-04-09 17:05:48 -0700 1 1 1 Unclassified WebKit New Bugs 528+ (Nightly build) Unspecified Unspecified RESOLVED WONTFIX P2 Normal --- 1 pfeldman ojan jchaffraix kbr oldest_to_newest 587047 0 pfeldman 2012-03-24 01:43:05 -0700 At first it seemed like the expectations dependency graph glitch, but I saw more and more = TEXT results as I was marking tests as SNOWLEOPARD = TEXT in the expectations. Could they actually be flaky? 587956 1 ojan 2012-03-26 11:45:39 -0700 Looks like ~120 of the css3/selectors3/xml tests are flaky. The text dump in some cases has two extra height==0, anonymous blocks that have empty RenderText's in them. 703457 2 kbr 2012-08-23 15:25:59 -0700 These tests are failing in the same way on the Chromium 10.7 debug bot, e.g.: http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7%20%28dbg%29/builds/71 Though interestingly not on the 10.7 release bot, e.g.: http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.7/builds/10973 Why would these differences in the render tree be occurring mainly in debug mode? I'm going to generalize these expected results from "SNOWLEOPARD" to "MAC". Simply adding "LION" seems like the wrong approach since we might add a Mountain Lion bot soon. 703472 3 kbr 2012-08-23 15:37:10 -0700 Committed r126487: <http://trac.webkit.org/changeset/126487> 703503 4 ojan 2012-08-23 16:06:32 -0700 Could we restrict these lines to DEBUG only? They don't seem to fail on release. 703635 5 kbr 2012-08-23 18:34:10 -0700 Yes, we could definitely tighten up the test expectations. All of the tests fail only on the debug bots except the following two: css3/selectors3/xml/css3-modsel-101.xml fails on 10.6 Release but passes (with occasional flake) on 10.6 (dbg) css3/selectors3/xml/css3-modsel-124b.xml fails on 10.6 Release but apparently passes on 10.6 (dbg) Let me try to update the expectations now. 703679 6 kbr 2012-08-23 20:01:19 -0700 Committed r126529: <http://trac.webkit.org/changeset/126529> 703684 7 ojan 2012-08-23 20:30:21 -0700 Thanks! This way we at least have test coverage for these tests in release. 872393 8 schenney 2013-04-09 17:05:48 -0700 Marked LayoutTest bugs, bugs with Chromium IDs, and some others as WontFix. Test failure bugs still are trackable via TestExpectations or disabled unit tests.