Bug 70372 - [nrwt] results.html should differentiate expected missing and unexpected missing
Summary: [nrwt] results.html should differentiate expected missing and unexpected missing
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Ryosuke Niwa
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-10-18 15:18 PDT by Ryosuke Niwa
Modified: 2011-10-20 15:47 PDT (History)
3 users (show)

See Also:


Attachments
fixes the bug (11.34 KB, patch)
2011-10-18 16:19 PDT, Ryosuke Niwa
ojan: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Ryosuke Niwa 2011-10-18 15:18:25 PDT
It appears that results.html treats all missing tests as one category. 

e.g.
http://build.webkit.org/builders/Chromium%20Mac%20Release%20%28Tests%29/builds/1884/steps/layout-test/logs/stdio
lists one unexpected missing test but
http://build.webkit.org/results/Chromium%20Mac%20Release%20(Tests)/r97786%20(1883)/results.html
lists all tests with results missing.
Comment 1 Ryosuke Niwa 2011-10-18 16:19:40 PDT
Created attachment 111522 [details]
fixes the bug
Comment 2 Dirk Pranke 2011-10-18 17:12:06 PDT
Comment on attachment 111522 [details]
fixes the bug

looks plausible to me, but ojan should probably probably be the one to review it.
Comment 3 Ojan Vafai 2011-10-18 19:11:01 PDT
Comment on attachment 111522 [details]
fixes the bug

View in context: https://bugs.webkit.org/attachment.cgi?id=111522&action=review

> LayoutTests/fast/harness/results.html:939
> +        forEach(document.querySelectorAll('table:not([id=missing-table]) tbody:not([mismatchreftest]) a[href$=".png"]'), convertToTogglingHandler(function(prefix) {

table:not(#missing-table) is better. faster and more straightforward.

Can the missing table not toggle? Seems like it would be nice.

> LayoutTests/fast/harness/results.html:942
> +        forEach(document.querySelectorAll('table:not([id=missing-table]) tbody:not([mismatchreftest]) img[src$=".png"]'), convertToTogglingHandler(togglingImage));

ditto

> LayoutTests/fast/harness/results.html:1055
>      html += failingTestsTable(globalState().flakyTests,
>          'Flaky tests (failed the first run and got a different result on retry)', 'flaky-tests-table');
>  
>      if (globalState().timeoutTests.length)
>          html += testList(globalState().timeoutTests, 'Tests that timed out', 'timeout-tests-table');
>  

Not related to this patch obviously, but noticed it looking at this code. I wonder if we should put the flaky tests as the last list.
Comment 4 Ryosuke Niwa 2011-10-20 15:47:10 PDT
Committed r98031: <http://trac.webkit.org/changeset/98031>