Bug 175674

Summary: [GTK] Remove some obsolete expected failures.
Product: WebKit Reporter: Ms2ger (he/him; ⌚ UTC+1/+2) <Ms2ger>
Component: WebKitGTKAssignee: Ms2ger (he/him; ⌚ UTC+1/+2) <Ms2ger>
Status: RESOLVED FIXED    
Severity: Normal CC: bugs-noreply, buildbot, calvaris, commit-queue, dbates, mcatanzaro, mkwst
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Bug Depends on:    
Bug Blocks: 158924, 160024, 168415    
Attachments:
Description Flags
Patch
none
Archive of layout-test-results from ews122 for ios-simulator-wk2 none

Description Ms2ger (he/him; ⌚ UTC+1/+2) 2017-08-17 09:09:27 PDT
.
Comment 1 Ms2ger (he/him; ⌚ UTC+1/+2) 2017-08-17 09:11:31 PDT
Created attachment 318370 [details]
Patch
Comment 2 Michael Catanzaro 2017-08-17 09:14:31 PDT
You need to also close the bugs associated with tests that are now passing, if all the tests are now passing. Good to leave a comment mentioning which commit fixed the tests, if known.

If not all the tests are now passing, consider leaving a comment to mention which ones started to pass and when.
Comment 3 Michael Catanzaro 2017-08-17 09:21:58 PDT
Comment on attachment 318370 [details]
Patch

Be sure to check the history of the tests as well, to make sure they're not flaky. For example:

$ ./wktesthunter svg/dom/SVGScriptElement/script-change-externalResourcesRequired-while-loading.svg

That reveals the test has been alternately timing out and passing. So we should not be removing it from expected failures, because it's still expected to fail. We should be adding a pass expectation so that it doesn't show up under unexpected passes anymore.
Comment 4 Build Bot 2017-08-17 11:52:41 PDT
Comment on attachment 318370 [details]
Patch

Attachment 318370 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/4331474

New failing tests:
http/tests/security/cross-origin-indexeddb.html
Comment 5 Build Bot 2017-08-17 11:52:43 PDT
Created attachment 318393 [details]
Archive of layout-test-results from ews122 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews122  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.5
Comment 6 Ms2ger (he/him; ⌚ UTC+1/+2) 2017-08-18 00:15:09 PDT
(In reply to Michael Catanzaro from comment #3)
> Comment on attachment 318370 [details]
> Patch
> 
> Be sure to check the history of the tests as well, to make sure they're not
> flaky. For example:
> 
> $ ./wktesthunter
> svg/dom/SVGScriptElement/script-change-externalResourcesRequired-while-
> loading.svg
> 
> That reveals the test has been alternately timing out and passing. So we
> should not be removing it from expected failures, because it's still
> expected to fail. We should be adding a pass expectation so that it doesn't
> show up under unexpected passes anymore.

That's exactly what I did:

+webkit.org/b/174240 svg/dom/SVGScriptElement/script-change-externalResourcesRequired-while-loading.svg [ Pass Timeout ]
Comment 7 Xabier Rodríguez Calvar 2017-08-18 01:41:55 PDT
Comment on attachment 318370 [details]
Patch

And as Michael said, please close the bugs if you can.
Comment 8 WebKit Commit Bot 2017-08-18 02:12:41 PDT
Comment on attachment 318370 [details]
Patch

Clearing flags on attachment: 318370

Committed r220911: <http://trac.webkit.org/changeset/220911>
Comment 9 WebKit Commit Bot 2017-08-18 02:12:43 PDT
All reviewed patches have been landed.  Closing bug.