107328 2013-01-18 14:38:35 -0800 [chromium] DumpRenderTree is getting the contents of a previous test 2013-04-08 15:58:45 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED WONTFIX P2 Normal --- 1 hclam japhet abarth dpranke japhet schenney tony oldest_to_newest 811057 0 hclam 2013-01-18 14:38:35 -0800 This test is reported to be MISSING: http://test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=http%2Ftests%2Fcache%2Fcancel-multiple-post-xhrs.html But however the actual results comes from a previous test run. 811063 1 hclam 2013-01-18 14:44:46 -0800 Committed r140210: <http://trac.webkit.org/changeset/140210> 819260 2 dpranke 2013-01-29 13:12:01 -0800 So, what seems to be happening here is that http/tests/cache/cancel-during-revalidation-succeeded.html is somehow messing up state inside DRT so that when we run the next test (http/tests/cache/cancel-multiple-post-xhrs.html), the dumpAsText() call is not having any effect, and we're incorrectly dumping out a render tree and generating a pixel result (and since there's no -expected.png, we report this as MISSING). If you look at the actual results being generated on the flakiness dashboard, you can see the incorrect render tree. This is kinda interesting, since it's at least the first case I've seen which deterministically (reliably) is causing dumpAsText() to have no effect and we can't blame this on a script not getting loaded. As an aside, the second test (cancel-multiple-post-xhrs) is also printing out output inside WebProxyTestBase::willSendRequest) *before* we print the test headers in TestEventPrinter::handleTextHeader(). This is probably bad, not the least of which is because the NRWT driver.py code is handling this only by accident. So, there's a couple of different bugs being revealed here. 819262 3 dpranke 2013-01-29 13:16:21 -0800 Note that the http/tests/cache/cancel-during-revalidation-succeeded.html appears to be a known problem (at least on linux) as noted from bug 96950. Also, the "actual results come from a previous test run" part refers the output from cancel-during-revalidation-succeeded.html showing up as the -actual for cancel-multiple-post-xhrs.html . 819324 4 dpranke 2013-01-29 14:19:50 -0800 Punting this to Nate ... it appears that both NRWT and DRT are working correctly, and when we attempt to load the second URL, we're getting the contents of the first URL (in some form) back. I am able to reproduce this consistently on my mac sync'ed to r141137 in a release build. It does not appear to reproduce in a debug build at the same revision (at least, not easily). run-webkit-tests --chromium --no-new-test-results --clobber-old-results http/tests/cache/cancel-during-revalidation-succeeded.html http/tests/cache/cancel-multiple-post-xhrs.html 819326 5 dpranke 2013-01-29 14:21:03 -0800 Also, editing the subject line to reflect my current understanding. Was: "Layout test runner is confused with output from different tests" Now: "[chromium] DumpRenderTree is getting the contents of a previous test" I have no idea yet if this reproduces on other ports. 819343 6 dpranke 2013-01-29 14:43:15 -0800 It does not appear to reproduce on the apple mac port at the same revision.