Bug 99626 - Unable to rebaseline windows tests
Summary: Unable to rebaseline windows tests
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Dirk Pranke
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-10-17 12:15 PDT by Dana Jansens
Modified: 2012-10-17 13:23 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Dana Jansens 2012-10-17 12:15:34 PDT
The following test are failing on the windows canary bots, but when I rebaseline them with webkit-patch rebaseline, or garden-o-matic, it does not update anything.

ietestcenter/css3/bordersbackgrounds/border-radius-content-edge-001.htm
css1/basic/inheritance.html
fast/sub-pixel/selection/selection-rect-in-sub-pixel-table.html
svg/zoom/page/zoom-svg-through-object-with-absolute-size-2.xhtml
tables/mozilla/bugs/bug73321.html

This is the 2nd day that these tests have been acting like this. They are part of a larger set, the others rebaselined successfully, but these are not.
Comment 1 Dirk Pranke 2012-10-17 12:24:46 PDT
looking
Comment 2 Dirk Pranke 2012-10-17 12:32:19 PDT
These five tests are only failing in Debug mode, and we don't check in baselines that only affect Debug if we also have Release bots in that config (since then Release would start to fail). In this situation you need to suppress the failures and file a bug for someone to figure out why we're getting different output in Debug and Release.
Comment 3 Dirk Pranke 2012-10-17 12:32:52 PDT
whoops, shouldn't have wontfix'ed this until I was sure my explanation made sense to you (I didn't actually look at the failures in detail).
Comment 4 Dana Jansens 2012-10-17 12:40:08 PDT
Does it change anything that the release bot is still failing these tests too? Tho garden-o-matic doesn't seem aware.

http://build.chromium.org/p/chromium.webkit/builders/WebKit%20Win7/builds/143/steps/webkit_tests
Comment 5 Dirk Pranke 2012-10-17 12:44:57 PDT
Yes, that would definitely change things :). That sounds like a bug in g-o-m. Looking again.
Comment 6 Dirk Pranke 2012-10-17 12:53:56 PDT
Okay, the problem is that the Win7 Release results are not being uploaded to the correct folder, and so we're not finding them (so I think we think the tests are passing on Win7 Release). Unfortunately, garden-o-matic isn't reporting an error in this case. 

Separately, it looks like the data in Tools/Scripts/webkitpy/layout_tests/port/builders.py is wrong; I'm not sure what the implications of that is except that bad things would probably happen between win7 and xp baselines.

Working on it ...
Comment 7 Dirk Pranke 2012-10-17 13:16:08 PDT
Okay, you should be getting the windows baselines now. Let me know if you still have issues. I'll file other bugs for the lack-of-error and the builders.py issues.
Comment 8 Dana Jansens 2012-10-17 13:23:05 PDT
Yup! Thanks :)