Bug 72498 - NRWT not running webkit_gpu_tests properly for Leopard (Mac OS 10.5)
Summary: NRWT not running webkit_gpu_tests properly for Leopard (Mac OS 10.5)
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Mac OS X 10.5
: P2 Normal
Assignee: Dirk Pranke
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-11-16 06:28 PST by epoger
Modified: 2012-02-29 12:36 PST (History)
6 users (show)

See Also:


Attachments
Patch (1.65 KB, patch)
2011-11-16 12:32 PST, Dirk Pranke
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description epoger 2011-11-16 06:28:06 PST
Split off of https://bugs.webkit.org/show_bug.cgi?id=72275 ('check-webkit-style broken by r99773: "Could not determine the port"') ...

As of this point, webkit_gpu_tests was green for Leopard:
http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.5%20%28CG%29/builds/1197 
webkit r100350
chromium r110212
[from webkit_gpu_tests stdio] Found:  254 tests

The next run had a failure while parsing expectations:
http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.5%20%28CG%29/builds/1198
webkit r100373
chromium r110235

That continued to be the case until this run:
http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Mac10.5%20%28CG%29/builds/1202
webkit r100398
chromium r110256
At this point, it was able to parse the expectations but was now trying to run 27185 tests instead of 254.  (NRWT is apparently interpreting the chromium-gpu-cg-mac platform as a CPU platform, not a GPU platform)
[from webkit_gpu_tests stdio] Found:  27185 tests

As of webkit r100439 , I can confirm that it is still trying to run 27185 tests.

Based on the evidence above, I believe this is the result of a webkit change within the range r100350:r100398 .
Comment 2 Tony Chang 2011-11-16 09:46:37 PST
It looks like this is due to r100355.

Now that we moved the tests into the regular layout test run, on chromium-gpu-cg-mac-leopard, paths is empty, so test_files.find() returns all tests.

It seems like we just want to remove the webkit_gpu_tests step from the Leopard bots.

James or Dirk, can you confirm that this is the desired behavior?
Comment 3 Dirk Pranke 2011-11-16 10:06:29 PST
(In reply to comment #2)
> It looks like this is due to r100355.
> 
> Now that we moved the tests into the regular layout test run, on chromium-gpu-cg-mac-leopard, paths is empty, so test_files.find() returns all tests.
> 
> It seems like we just want to remove the webkit_gpu_tests step from the Leopard bots.
> 
> James or Dirk, can you confirm that this is the desired behavior?

Ah, whoops, I forgot about that default behavior, and had assumed that there would still be some tests to run, but I didn't think it through. Obviously, we don't want to run all 27k tests on Leopard ;).

Yeah, we can either remove the webkit_gpu_tests step from Leopard, or give them some dummy list of paths to run just to be a no-op (e.g., one test or a small directory or something) until we can remove webkit_gpu_tests everywhere.
Comment 4 epoger 2011-11-16 10:28:39 PST
(In reply to comment #3)
> (In reply to comment #2)
> > It looks like this is due to r100355.
> > 
> > Now that we moved the tests into the regular layout test run, on chromium-gpu-cg-mac-leopard, paths is empty, so test_files.find() returns all tests.
> > 
> > It seems like we just want to remove the webkit_gpu_tests step from the Leopard bots.
> > 
> > James or Dirk, can you confirm that this is the desired behavior?
> 
> Ah, whoops, I forgot about that default behavior, and had assumed that there would still be some tests to run, but I didn't think it through. Obviously, we don't want to run all 27k tests on Leopard ;).
> 
> Yeah, we can either remove the webkit_gpu_tests step from Leopard, or give them some dummy list of paths to run just to be a no-op (e.g., one test or a small directory or something) until we can remove webkit_gpu_tests everywhere.

How is it that Leopard and SnowLeopard are being treated differently?  Shouldn't they both be treated essentially the same?
Comment 5 Dirk Pranke 2011-11-16 11:37:55 PST
(In reply to comment #4)
> How is it that Leopard and SnowLeopard are being treated differently?  Shouldn't they both be treated essentially the same?

IIRC, we don't support accelerated video compositing on Leopard, but we do on SL.
Comment 6 Dirk Pranke 2011-11-16 12:17:43 PST
Okay, per conversation w/ jamesr just now, it looks like it might make the most sense to just stop running webkit_gpu_tests on Leopard CG.
Comment 7 Dirk Pranke 2011-11-16 12:24:18 PST
http://codereview.chromium.org/8575012/

I think this'll require a master restart, though. In the meantime, it's not great that we're running 27k tests, so I'll upload a hack to run *something*.
Comment 8 Dirk Pranke 2011-11-16 12:32:29 PST
Created attachment 115423 [details]
Patch
Comment 9 James Robinson 2011-11-16 12:33:22 PST
Comment on attachment 115423 [details]
Patch

R=me
Comment 10 James Robinson 2011-11-16 12:35:01 PST
Sorry about that, the intent was to run zero tests on 10.5 webkit_gpu_tests.  We don't ship accelerated compositing on that platform and afaik never intend to, so there aren't any tests that are useful to run on that platform in the gpu configuration.
Comment 11 Dirk Pranke 2011-11-16 12:42:55 PST
Committed r100491: <http://trac.webkit.org/changeset/100491>
Comment 12 WebKit Review Bot 2011-11-16 14:44:32 PST
Comment on attachment 115423 [details]
Patch

Clearing flags on attachment: 115423

Committed r100509: <http://trac.webkit.org/changeset/100509>
Comment 13 WebKit Review Bot 2011-11-16 14:44:37 PST
All reviewed patches have been landed.  Closing bug.
Comment 14 Dirk Pranke 2011-11-16 14:57:48 PST
This was closed incorrectly (and landed twice) because I forgot to clear the CQ+ flag; I mean to leave it open until the buildbot picks up the other change and I can revert the hack to chromium_gpu.py.
Comment 15 Dirk Pranke 2012-02-29 12:36:49 PST
Ok, the CG bots are gone. We're still running fast/canvas and canvas/philip on the Leopard bot (now a Skia bot), and although they are not accelerated, the tests are passing.

Given that I'm trying to remove the webkit_gpu_tests step completely, I'm going to ignore this for now and close this bug.