Bug 154964 – Slow JSC stress tests times out in 32 bit debug mode

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Csaba Osztrogonác]

http://trac.webkit.org/changeset/197442 disabled FTL JIT testing 
on 32 bit bots, because there is no FTL JIT on any 32 bit platforms.

But 25-35 tests started to fail on these bots:
- https://build.webkit.org/builders/Apple%20El%20Capitan%2032-bit%20JSC%20%28BuildAndTest%29/builds/1658
- https://build.webkit.org/builders/Apple%20Yosemite%2032-bit%20JSC%20%28BuildAndTest%29

The problem is that these tests seems to be very slow in debug mode,
but they didn't fail previously because jsc-stress-tests script
duplicated the timeout in case of FTL JIT is enabled:

if $enableFTL and ENV["JSCTEST_timeout"]
    # Currently, using the FTL is a performance regression particularly in real
    # (i.e. non-loopy) benchmarks. Account for this in the timeout.
    ENV["JSCTEST_timeout"] = (ENV["JSCTEST_timeout"].to_i * 2).to_s
end

It seems we should duplicate timeout in debug mode too.

[Csaba Osztrogonác]

My first idea was to replace $enableFtl condition with
($enableFTL or !$ifJSCArgIsntProvidedAreWeReleaseBuild),
but unfortunately run-javascriptcore-tests doesn't pass
through the --debug option to run-jsc-stress-tests.

I don't have time to investigate this bug, feel free to pick it up.

But maybe the simplest fix is to set JSCTEST_timeout 
environment on these bots to a high enough number.

[Alexey Proskuryakov]

Will fix by rolling out r197442. There is no reason to keep such a regression.

[Alexey Proskuryakov]

*** This bug has been marked as a duplicate of bug 154967 ***

[Csaba Osztrogonác]

Rolling out r197442 only hides this problem. The tests are still slow, relying
on increased timeout set by --ftl-jit option is incorrect and should be fixed.

[Alexey Proskuryakov]

This bug used to be a duplicate, because it said that the tests failed on bots. That is fixed via bug 154967.

You changed the title after the fact.

[Csaba Osztrogonác]

(In reply to comment #5)
> This bug used to be a duplicate, because it said that the tests failed on
> bots. That is fixed via bug 154967.
> 
> You changed the title after the fact.

I agree, the bug mentioned in the original title of the bug was "solved"
(papered over) by the rollout. But The description of this bug is clear
and the bug is still valid and should be fixed in the near future. The
original title was confusing, I just changed it to match with the desription.

It's not reasonable to rely on running useless FTL JIT tests (+50% runtime)
just to increase the JSCTEST_timeout on 32 bit debug JSC tester bots. We
should increase the timeout in debug mode in this bug and then we can
disable FTL JIT testing on all 32 bit bots in bug154858.

[Csaba Osztrogonác]

Created attachment 278495 [details]
Patch

[Michael Catanzaro]

Comment on attachment 278495 [details]
Patch

(Please commit when you're around to watch the bots.)

[WebKit Commit Bot]

Comment on attachment 278495 [details]
Patch

Clearing flags on attachment: 278495

Committed r201158: <http://trac.webkit.org/changeset/201158>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.