Bug 172378

Summary: Tests reporting FailureNotTested after r217130
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, dbates, jbedard, jlewis3
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=172322
https://bugs.webkit.org/show_bug.cgi?id=172609
https://bugs.webkit.org/show_bug.cgi?id=172610
https://bugs.webkit.org/show_bug.cgi?id=172616
https://bugs.webkit.org/show_bug.cgi?id=172672
https://bugs.webkit.org/show_bug.cgi?id=172772
https://bugs.webkit.org/show_bug.cgi?id=173380

Description Ryan Haddad 2017-05-19 12:44:16 PDT
The following tests are reporting FailureNotTested after https://trac.webkit.org/changeset/217130/ was landed:

Regressions: Unexpected missing results (8)
  fast/loader/recursive-before-unload-crash.html [ Missing ]
  fast/repaint/table-hover-on-link.html [ Missing ]
  http/tests/misc/slow-loading-mask.html [ Missing ]
  http/tests/multipart/policy-ignore-crash.php [ Missing ]
  http/tests/navigation/back-twice-without-commit.html [ Missing ]
  imported/blink/fast/block/float/float-mark-descendants-for-layout-crash.html [ Missing ]
  imported/blink/fast/frames/freed-frame.html [ Missing ]
  imported/blink/printing/print-document-without-documentElement-crash.html [ Missing ]

https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/1100
Comment 1 Ryan Haddad 2017-05-19 12:45:26 PDT
This means that the test had no output when it was run.
Comment 2 Alexey Proskuryakov 2017-05-19 12:50:05 PDT
We have tests that legitimately have no output, so I'm not sure if r217130 was right.
Comment 3 Jonathan Bedard 2017-05-19 12:56:59 PDT
(In reply to Alexey Proskuryakov from comment #2)
> We have tests that legitimately have no output, so I'm not sure if r217130
> was right.

If the expected file is empty, this logic will not be triggered.
Comment 4 Ryan Haddad 2017-05-19 13:14:29 PDT
I skipped the tests in https://webkit.org/b/172378 so that they would not affect EWS. 

Of note, there were expectations in place for a few of the tests. I removed them so that the 'Skip' wouldn't be overridden, but we may end up having to restore the original expectations at some point.
Comment 5 Alexey Proskuryakov 2017-05-24 21:09:19 PDT
fetch/closing-while-fetching-blob.html is another (flakily) affected test, could you please skip it and file a new bug?