Across 18 recent runs of the Lion Debug WebKit2 test bot, each one of these appcache tests has failed at least once:
It’s likely that the reason is that running appcache tests concurrently causes them to fail.
Added http/tests/appcache to the Mac WebKit2 skip list in <http://trac.webkit.org/r111868>.
I think I've seen this on the chromium bots as well, so I wouldn't be too surprised by this.
Added http/tests/inspector/appcache to the Mac WebKit2 skip list in <http://trac.webkit.org/r111879>.
On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case?
(In reply to comment #5)
> On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case?
Even if that’s the case, we may have cross-talk between http/tests/appcache and http/tests/inspector/appcache.
(In reply to comment #6)
> (In reply to comment #5)
> > On the other hand, I now recall that NRWT was supposed to run tests within a single directory sequentially. Is this still the case?
> Even if that’s the case, we may have cross-talk between http/tests/appcache and http/tests/inspector/appcache.
Yes, NRWT runs tests within a single directory sequentially unless you run with the -f / --fully-parallel flag.
Enabled the tests in <http://trac.webkit.org/r169006>, and bots haven't seen any failures so far.
Notably, we don't have anything in http/tests/inspector/appcache now.