Bug 180568 – Make policy decisions asynchronous

• Component: New Bugs
• Status: RESOLVED FIXED

[Alex Christensen]

Make policy decisions asynchronous

[Alex Christensen]

Created attachment 328779 [details]
Patch

[Alex Christensen]

Comment on attachment 328779 [details]
Patch

WIP, almost certainly has problems.  Double check all API tests, especially WebKit.JavaScriptDuringNavigation and download tests without NETWORK_SESSION.

[Geoffrey Garen]

Will this change help resolve some of the regressions caused by the async policy delegate change?

I ask because I don't think we should push further in the direction of design changes that increase async behavior until we've first finished resolving the regressions caused by the last batch of async behavior.

[Alex Christensen]

This is a significant change that I don't think we should do right now anyways.  I just wanted to see what it would take to get working.

[Alex Christensen]

Created attachment 331568 [details]
Patch

[EWS Watchlist]

Comment on attachment 331568 [details]
Patch

Attachment 331568 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6114864

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 331575 [details]
Archive of layout-test-results from ews107 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 331568 [details]
Patch

Attachment 331568 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6114928

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 331579 [details]
Archive of layout-test-results from ews125 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews125  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 333618 [details]
Rebased

[EWS Watchlist]

Comment on attachment 333618 [details]
Rebased

Attachment 333618 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6470386

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 333625 [details]
Archive of layout-test-results from ews121 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews121  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 333618 [details]
Rebased

Attachment 333618 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6471172

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 333630 [details]
Archive of layout-test-results from ews106 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

WebResourceLoader::didReceiveResponse() sends the NetworkResourceLoader::ContinueDidReceiveResponse IPC back to the network process right after calling ResourceLosder::didReceiveResponse(). Unfortunately, if the client replies asynchronously to the decidePolicyForNavigationResponse delegate, then this IPC will be sent before receiving the policy response. As a result, we'll start receiving data and even potentially commit the provisional load before the client responds to the policy delegate. I think we need to delay the NetworkResourceLoader::ContinueDidReceiveResponse IPC until we get a policy response from the client.

[Chris Dumez]

(In reply to Chris Dumez from comment #15)
> WebResourceLoader::didReceiveResponse() sends the
> NetworkResourceLoader::ContinueDidReceiveResponse IPC back to the network
> process right after calling ResourceLosder::didReceiveResponse().
> Unfortunately, if the client replies asynchronously to the
> decidePolicyForNavigationResponse delegate, then this IPC will be sent
> before receiving the policy response. As a result, we'll start receiving
> data and even potentially commit the provisional load before the client
> responds to the policy delegate. I think we need to delay the
> NetworkResourceLoader::ContinueDidReceiveResponse IPC until we get a policy
> response from the client.

Will address this via Bug 182720.

[Chris Dumez]

<rdar://problem/37131297>

[Chris Dumez]

Created attachment 334384 [details]
Rebased

[EWS Watchlist]

Comment on attachment 334384 [details]
Rebased

Attachment 334384 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6610732

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334391 [details]
Archive of layout-test-results from ews105 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews105  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334384 [details]
Rebased

Attachment 334384 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6610549

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334392 [details]
Archive of layout-test-results from ews121 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews121  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 334834 [details]
Rebased

[EWS Watchlist]

Comment on attachment 334834 [details]
Rebased

Attachment 334834 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6723730

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334840 [details]
Archive of layout-test-results from ews107 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334834 [details]
Rebased

Attachment 334834 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6724130

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334843 [details]
Archive of layout-test-results from ews123 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews123  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 334903 [details]
With some tests rebaselined

[EWS Watchlist]

Comment on attachment 334903 [details]
With some tests rebaselined

Attachment 334903 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/6737406

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334909 [details]
Archive of layout-test-results from ews101 for mac-sierra

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews101  Port: mac-sierra  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334903 [details]
With some tests rebaselined

Attachment 334903 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/6737421

Number of test failures exceeded the failure limit.

[EWS Watchlist]

Created attachment 334912 [details]
Archive of layout-test-results from ews115 for mac-sierra

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews115  Port: mac-sierra  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334903 [details]
With some tests rebaselined

Attachment 334903 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6737832

New failing tests:
http/tests/misc/window-dot-stop.html
webarchive/loading/video-in-webarchive.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/loader/redirect-to-invalid-url-using-javascript-disallowed.html
fast/loader/onload-policy-ignore-for-frame.html
fast/html/marquee-reparent-check.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/loading/simple-subframe.html
http/tests/security/mixedContent/insecure-css-with-secure-cookies.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/dom/window-open-about-webkit-org-and-access-document.html
fast/loader/window-open-to-invalid-url-disallowed.html
http/tests/workers/service/service-worker-download.https.html
webarchive/loading/test-loading-archive.html
fast/loader/redirect-to-invalid-url-using-meta-refresh-disallowed.html
loader/go-back-cached-main-resource.html
contentfiltering/block-after-will-send-request-then-deny-unblock.html
http/tests/security/frame-loading-via-document-write.html
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
fast/frames/iframe-plugin-load-remove-document-crash.html
contentfiltering/block-after-will-send-request.html

[EWS Watchlist]

Created attachment 334914 [details]
Archive of layout-test-results from ews126 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews126  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334903 [details]
With some tests rebaselined

Attachment 334903 [details] did not pass win-ews (win):
Output: http://webkit-queues.webkit.org/results/6739588

New failing tests:
fast/loader/iframe-meta-refresh-base-blank.html
http/tests/navigation/redirect-to-fragment.html
http/tests/loading/redirect-with-no-location-crash.html
http/tests/loading/bad-server-subframe.html
http/tests/contentdispositionattachmentsandbox/cross-origin-frames-disabled.html
http/tests/loading/slow-parsing-subframe.html
fast/loader/subframe-removes-itself.html
fast/loader/fragment-navigation-base-blank.html
http/tests/security/blocked-on-redirect.html
http/tests/navigation/redirect-to-invalid-url.html
http/tests/loading/server-redirect-for-provisional-load-caching.html
fast/loader/iframe-set-location-base-blank.html
fast/loader/refresh-iframe-base-blank.html

[EWS Watchlist]

Created attachment 334922 [details]
Archive of layout-test-results from ews202 for win-future

The attached test failures were seen while running run-webkit-tests on the win-ews.
Bot: ews202  Port: win-future  Platform: CYGWIN_NT-6.1-2.9.0-0.318-5-3-x86_64-64bit

[Chris Dumez]

Created attachment 334935 [details]
With tests rebaselined only for wk2

[Chris Dumez]

Created attachment 334937 [details]
With tests rebaselined only for wk2

[EWS Watchlist]

Comment on attachment 334937 [details]
With tests rebaselined only for wk2

Attachment 334937 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6741882

New failing tests:
http/tests/misc/window-dot-stop.html
fast/loader/window-open-to-invalid-url-disallowed.html
http/tests/security/frame-loading-via-document-write.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/events/before-unload-returnValue.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
fast/loader/onload-policy-ignore-for-frame.html
inspector/page/frameScheduledNavigation.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/loading/authentication-after-redirect-stores-wrong-credentials/authentication-after-redirect-stores-wrong-credentials.html
imported/w3c/web-platform-tests/html/semantics/text-level-semantics/the-a-element/a-download-click-404.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/dom/window-open-about-webkit-org-and-access-document.html
fast/loader/redirect-to-invalid-url-using-meta-refresh-disallowed.html
contentfiltering/block-after-will-send-request-then-deny-unblock.html
contentfiltering/block-after-will-send-request.html
fast/loader/redirect-to-invalid-url-using-javascript-disallowed.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 334941 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 334937 [details]
With tests rebaselined only for wk2

Attachment 334937 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6741938

New failing tests:
http/tests/misc/window-dot-stop.html
http/tests/loading/simple-subframe.html
fast/loader/window-open-to-invalid-url-disallowed.html
http/tests/security/frame-loading-via-document-write.html
contentfiltering/block-after-will-send-request.html
http/tests/security/mixedContent/insecure-css-with-secure-cookies.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
fast/loader/onload-policy-ignore-for-frame.html
fast/loader/redirect-to-invalid-url-using-javascript-disallowed.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/loading/authentication-after-redirect-stores-wrong-credentials/authentication-after-redirect-stores-wrong-credentials.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/dom/window-open-about-webkit-org-and-access-document.html
fast/loader/redirect-to-invalid-url-using-meta-refresh-disallowed.html
contentfiltering/block-after-will-send-request-then-deny-unblock.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 334942 [details]
Archive of layout-test-results from ews122 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews122  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335140 [details]
WIP patch

[EWS Watchlist]

Comment on attachment 335140 [details]
WIP patch

Attachment 335140 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6832375

New failing tests:
http/tests/loading/simple-subframe.html
http/tests/navigation/page-cache-iframe-provisional-load.html
http/tests/security/mixedContent/insecure-css-with-secure-cookies.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/loading/authentication-after-redirect-stores-wrong-credentials/authentication-after-redirect-stores-wrong-credentials.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/dom/window-open-about-webkit-org-and-access-document.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/security/frame-loading-via-document-write.html

[EWS Watchlist]

Created attachment 335156 [details]
Archive of layout-test-results from ews125 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews125  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335140 [details]
WIP patch

Attachment 335140 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6833563

New failing tests:
http/tests/security/frame-loading-via-document-write.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/events/before-unload-returnValue.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
inspector/page/frameScheduledNavigation.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/loading/authentication-after-redirect-stores-wrong-credentials/authentication-after-redirect-stores-wrong-credentials.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/dom/window-open-about-webkit-org-and-access-document.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 335162 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335210 [details]
WIP patch

[EWS Watchlist]

Comment on attachment 335210 [details]
WIP patch

Attachment 335210 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6844406

New failing tests:
http/tests/security/frame-loading-via-document-write.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/events/before-unload-returnValue.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
inspector/page/frameScheduledNavigation.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 335226 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335210 [details]
WIP patch

Attachment 335210 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6844379

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
http/tests/security/mixedContent/insecure-css-with-secure-cookies.html
http/tests/security/contentSecurityPolicy/block-all-mixed-content/insecure-css-in-main-frame.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/security/frame-loading-via-document-write.html

[EWS Watchlist]

Created attachment 335228 [details]
Archive of layout-test-results from ews124 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews124  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335243 [details]
WIP patch

[EWS Watchlist]

Comment on attachment 335243 [details]
WIP patch

Attachment 335243 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6848601

New failing tests:
http/tests/security/frame-loading-via-document-write.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/events/before-unload-returnValue.html
inspector/page/frameScheduledNavigation.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 335252 [details]
Archive of layout-test-results from ews106 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335243 [details]
WIP patch

Attachment 335243 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6848663

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
http/tests/security/mixedContent/insecure-css-with-secure-cookies.html
imported/w3c/web-platform-tests/cors/remote-origin.htm
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/security/frame-loading-via-document-write.html

[EWS Watchlist]

Created attachment 335255 [details]
Archive of layout-test-results from ews125 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews125  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335324 [details]
WIP Patch

[Chris Dumez]

Created attachment 335326 [details]
WIP Patch

[EWS Watchlist]

Comment on attachment 335326 [details]
WIP Patch

Attachment 335326 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6861041

New failing tests:
http/tests/security/frame-loading-via-document-write.html
webarchive/loading/mainresource-null-mimetype-crash.html
fast/events/before-unload-returnValue.html
inspector/page/frameScheduledNavigation.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 335337 [details]
Archive of layout-test-results from ews106 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335326 [details]
WIP Patch

Attachment 335326 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6860956

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
http/tests/workers/service/service-worker-download.https.html
fast/html/marquee-reparent-check.html
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
http/tests/security/frame-loading-via-document-write.html

[EWS Watchlist]

Created attachment 335338 [details]
Archive of layout-test-results from ews122 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews122  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335652 [details]
WIP Patch

[Chris Dumez]

Created attachment 335660 [details]
WIP Patch

[EWS Watchlist]

Comment on attachment 335660 [details]
WIP Patch

Attachment 335660 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6926130

New failing tests:
http/tests/loading/basic-auth-load-URL-with-consecutive-slashes.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
http/tests/navigation/page-cache-iframe-provisional-load.html

[EWS Watchlist]

Created attachment 335667 [details]
Archive of layout-test-results from ews126 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews126  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335660 [details]
WIP Patch

Attachment 335660 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6926711

New failing tests:
inspector/page/frameScheduledNavigation.html
http/tests/navigation/page-cache-iframe-provisional-load.html
webarchive/loading/mainresource-null-mimetype-crash.html

[EWS Watchlist]

Created attachment 335668 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335670 [details]
WIP Patch

[Chris Dumez]

There should be only one failure left:
http/tests/navigation/page-cache-iframe-provisional-load.html

Which will be dealt with via Bug 183386.

[EWS Watchlist]

Comment on attachment 335670 [details]
WIP Patch

Attachment 335670 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6928257

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
webarchive/loading/mainresource-null-mimetype-crash.html

[EWS Watchlist]

Created attachment 335674 [details]
Archive of layout-test-results from ews107 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335670 [details]
WIP Patch

Attachment 335670 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6928215

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html
webarchive/loading/mainresource-null-mimetype-crash.html

[EWS Watchlist]

Created attachment 335676 [details]
Archive of layout-test-results from ews126 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews126  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335679 [details]
WIP Patch

[EWS Watchlist]

Comment on attachment 335679 [details]
WIP Patch

Attachment 335679 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6930264

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html

[EWS Watchlist]

Created attachment 335681 [details]
Archive of layout-test-results from ews107 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335679 [details]
WIP Patch

Attachment 335679 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6930295

New failing tests:
http/tests/navigation/page-cache-iframe-provisional-load.html
fast/loader/javascript-url-iframe-remove-on-navigate.html

[EWS Watchlist]

Created attachment 335682 [details]
Archive of layout-test-results from ews124 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews124  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335708 [details]
Patch

[Chris Dumez]

Looks like fast/loader/javascript-url-iframe-remove-on-navigate.html is a flaky crash on iOS, so close. Investigating now.

[EWS Watchlist]

Comment on attachment 335708 [details]
Patch

Attachment 335708 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6938725

New failing tests:
fast/loader/javascript-url-iframe-remove-on-navigate-async-delegate.html
fast/loader/javascript-url-iframe-remove-on-navigate.html

[EWS Watchlist]

Created attachment 335719 [details]
Archive of layout-test-results from ews126 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews126  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335753 [details]
Patch

[WebKit Commit Bot]

Comment on attachment 335753 [details]
Patch

Clearing flags on attachment: 335753

Committed r229613: <https://trac.webkit.org/changeset/229613>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Ryan Haddad]

(In reply to WebKit Commit Bot from comment #86)
> Comment on attachment 335753 [details]
> Patch
> 
> Clearing flags on attachment: 335753
> 
> Committed r229613: <https://trac.webkit.org/changeset/229613>
This change caused 29 API test failures:
https://build.webkit.org/builders/Apple%20Sierra%20Release%20WK1%20(Tests)/builds/8798

[Chris Dumez]

(In reply to Ryan Haddad from comment #88)
> (In reply to WebKit Commit Bot from comment #86)
> > Comment on attachment 335753 [details]
> > Patch
> > 
> > Clearing flags on attachment: 335753
> > 
> > Committed r229613: <https://trac.webkit.org/changeset/229613>
> This change caused 29 API test failures:
> https://build.webkit.org/builders/Apple%20Sierra%20Release%20WK1%20(Tests)/
> builds/8798

Darn, I did not think of the API tests.. Let's roll out and I'll investigate those failures.

[Ryan Haddad]

Reverted r229613 for reason:

Caused API test failures

Committed r229617: <https://trac.webkit.org/changeset/229617>

[Chris Dumez]

Tests that failed:
  URLSchemeHandler.Redirection
  WKWebView.LoadAlternateHTMLStringFromProvisionalLoadErrorBackToBack

Tests that timed out:
  IconLoading.AlreadyCachedIcon
  IconLoading.DefaultFavicon
  IconLoading.IconLoadCancelledCallback
  IconLoading.IconLoadCancelledCallback2
  ServiceWorkers.Basic
  ServiceWorkers.FetchAfterRestoreFromDisk
  ServiceWorkers.HasServiceWorkerRegistrationBit
  ServiceWorkers.InterceptFirstLoadAfterRestoreFromDisk
  ServiceWorkers.NonDefaultSessionID
  ServiceWorkers.RestoreFromDisk
  ServiceWorkers.SWProcessConnectionCreation
  ServiceWorkers.ServiceWorkerAndCacheStorageDefaultDirectories
  ServiceWorkers.ServiceWorkerAndCacheStorageSpecificDirectories
  ServiceWorkers.ServiceWorkerProcessCreation
  ServiceWorkers.StorageProcessConnectionCreation
  ServiceWorkers.WaitForPolicyDelegate
  URLSchemeHandler.Basic
  WebKit.CustomHeaderFields
  WebKit.RestoreSessionStateContainingScrollRestorationDefault
  WebKit.ShowWebView
  WebKit.WKNavigationResponseJSONMIMEType
  WebKit.WKNavigationResponseJSONMIMEType2
  WebKit.WKNavigationResponseUnknownMIMEType
  WebKit.WKPageGetScaleFactorNotZero
  WebKit.WebGLPolicy
  WebKit.WebsitePoliciesDuringRedirect
  WebKit.WebsitePoliciesPlayAfterPreventedAutoplay

[Chris Dumez]

Looking at URLSchemeHandler.Redirection API test, I see that the API test scheme handler does:
    auto redirectResponse = adoptNS([[NSURLResponse alloc] initWithURL:task.request.URL MIMEType:nil expectedContentLength:0 textEncodingName:nil]);
    auto request = adoptNS([[NSURLRequest alloc] initWithURL:[NSURL URLWithString:@"testing:///redirected"]]);
    [(id<WKURLSchemeTaskPrivate>)task _didPerformRedirection:redirectResponse.get() newRequest:request.get()];
    ASSERT_FALSE(receivedRedirect);
    ASSERT_STREQ(task.request.URL.absoluteString.UTF8String, "testing:///redirected");
    NSString *html = @"<script>window.webkit.messageHandlers.testHandler.postMessage('Document URL: ' + document.URL);</script>";
    auto finalResponse = adoptNS([[NSURLResponse alloc] initWithURL:task.request.URL MIMEType:@"text/html" expectedContentLength:html.length textEncodingName:nil]);
    [task didReceiveResponse:finalResponse.get()];
    [task didReceiveData:[html dataUsingEncoding:NSUTF8StringEncoding]];
    [task didFinish];

All synchronously.

Now that policy delegates are async, the call to didReceiveResponse() happens while we're still processing the redirect from the _didPerformRedirection call. I thus see logging like so:
Received response during redirect processing.
Redirected scheme task would have been sent to a different URL.

Not sure what the best way to fix this is. My bet is that to maintain API compatibility, we'd have to make WebURLSchemeTaskProxy robust against this happening. E.g. if didReceiveResponse is called while we're still processing a redirect, then queue the response until the redirect has been processed.

Alex, please let me know if I'm wrong since I am not familiar with this code.

[Chris Dumez]

Created attachment 335858 [details]
Patch

[Chris Dumez]

Created attachment 335859 [details]
Patch

[Chris Dumez]

(In reply to Chris Dumez from comment #91)
> Tests that failed:
>   URLSchemeHandler.Redirection
>   WKWebView.LoadAlternateHTMLStringFromProvisionalLoadErrorBackToBack
> 
> Tests that timed out:
>   IconLoading.AlreadyCachedIcon
>   IconLoading.DefaultFavicon
>   IconLoading.IconLoadCancelledCallback
>   IconLoading.IconLoadCancelledCallback2
>   ServiceWorkers.Basic
>   ServiceWorkers.FetchAfterRestoreFromDisk
>   ServiceWorkers.HasServiceWorkerRegistrationBit
>   ServiceWorkers.InterceptFirstLoadAfterRestoreFromDisk
>   ServiceWorkers.NonDefaultSessionID
>   ServiceWorkers.RestoreFromDisk
>   ServiceWorkers.SWProcessConnectionCreation
>   ServiceWorkers.ServiceWorkerAndCacheStorageDefaultDirectories
>   ServiceWorkers.ServiceWorkerAndCacheStorageSpecificDirectories
>   ServiceWorkers.ServiceWorkerProcessCreation
>   ServiceWorkers.StorageProcessConnectionCreation
>   ServiceWorkers.WaitForPolicyDelegate
>   URLSchemeHandler.Basic
>   WebKit.CustomHeaderFields
>   WebKit.RestoreSessionStateContainingScrollRestorationDefault
>   WebKit.ShowWebView
>   WebKit.WKNavigationResponseJSONMIMEType
>   WebKit.WKNavigationResponseJSONMIMEType2
>   WebKit.WKNavigationResponseUnknownMIMEType
>   WebKit.WKPageGetScaleFactorNotZero
>   WebKit.WebGLPolicy
>   WebKit.WebsitePoliciesDuringRedirect
>   WebKit.WebsitePoliciesPlayAfterPreventedAutoplay

Remaining failures with this latest patch iteration:
  WebKit.RestoreSessionStateContainingScrollRestorationDefault
  WebKit.WKPageGetScaleFactorNotZero
  WebKit.WebsitePoliciesAutoplayQuirks
  WebKit.WebsitePoliciesPlayAfterPreventedAutoplay

[Alex Christensen]

(In reply to Chris Dumez from comment #92)
> Alex, please let me know if I'm wrong since I am not familiar with this code.
This test uses SPI on WKURLSchemeTaskPrivate and it's probably not critical to maintain complete API compatibility because that SPI should only be used with internal tests.

[Chris Dumez]

(In reply to Alex Christensen from comment #96)
> (In reply to Chris Dumez from comment #92)
> > Alex, please let me know if I'm wrong since I am not familiar with this code.
> This test uses SPI on WKURLSchemeTaskPrivate and it's probably not critical
> to maintain complete API compatibility because that SPI should only be used
> with internal tests.

I see. Well, it does not add much complexity as you can see in my latest patch.

[Alex Christensen]

I don't think we should maintain an assumption that redirection on WKURLSchemeTasks is effectively synchronous.  I'd prefer to just change the test to call didReceiveResponse, didReceiveData, and didFinish after decidePolicyForNavigationAction has finished.  If that doesn't work because didReceiveResponse is now asynchronous, we might need to take your solution to keep API compatibility with WKURLSchemeHandler.

[Chris Dumez]

(In reply to Alex Christensen from comment #98)
> I don't think we should maintain an assumption that redirection on
> WKURLSchemeTasks is effectively synchronous.  I'd prefer to just change the
> test to call didReceiveResponse, didReceiveData, and didFinish after
> decidePolicyForNavigationAction has finished.  If that doesn't work because
> didReceiveResponse is now asynchronous, we might need to take your solution
> to keep API compatibility with WKURLSchemeHandler.

We're not talking about a single API test here given how many failures were resolved by my change.

[Alex Christensen]

Ah, decidePolicyForNavigationResponse is also now always asynchronous, so the queueing is necessary.  Makes sense.  This was needed before if you had an asynchronous decidePolicyForNavigationResponse but nobody realized it.  It might be worth adding a regression test for that case that is now fixed.

r=me

[Chris Dumez]

Created attachment 335881 [details]
Patch

[Alex Christensen]

Comment on attachment 335881 [details]
Patch

The cleanups in DocumentLoader and WebURLSchemeTaskProxy should each be done in separate patches with unit tests similar to the API tests they fix but with a WKNavigationDelegate that asynchronously calls the completion handlers.  They are fixing existing bugs that are unrelated to the switch to make everything asynchronous.

[Chris Dumez]

(In reply to Chris Dumez from comment #101)
> Created attachment 335881 [details]
> Patch

With this latest iteration, I am down to 2 API tests failing:
  WebKit.WebsitePoliciesAutoplayQuirks
  WebKit.WebsitePoliciesPlayAfterPreventedAutoplay

[Chris Dumez]

(In reply to Alex Christensen from comment #102)
> Comment on attachment 335881 [details]
> Patch
> 
> The cleanups in DocumentLoader and WebURLSchemeTaskProxy should each be done
> in separate patches with unit tests similar to the API tests they fix but
> with a WKNavigationDelegate that asynchronously calls the completion
> handlers.  They are fixing existing bugs that are unrelated to the switch to
> make everything asynchronous.

Ok.

[EWS Watchlist]

Comment on attachment 335881 [details]
Patch

Attachment 335881 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6970674

New failing tests:
http/wpt/html/browsers/history/the-location-interface/location-protocol-setter-non-broken-async-delegate.html

[EWS Watchlist]

Created attachment 335892 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335881 [details]
Patch

Attachment 335881 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6970822

New failing tests:
http/wpt/html/browsers/history/the-location-interface/location-protocol-setter-non-broken-async-delegate.html

[EWS Watchlist]

Created attachment 335897 [details]
Archive of layout-test-results from ews123 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews123  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Created attachment 335955 [details]
Patch

[Chris Dumez]

Created attachment 335991 [details]
Patch

[EWS Watchlist]

Comment on attachment 335991 [details]
Patch

Attachment 335991 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6991974

New failing tests:
fast/loader/inner-iframe-loads-data-url-into-parent-on-unload-crash.html

[EWS Watchlist]

Created attachment 335993 [details]
Archive of layout-test-results from ews104 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 335991 [details]
Patch

Attachment 335991 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/6991735

New failing tests:
fast/loader/inner-iframe-loads-data-url-into-parent-on-unload-crash.html

[EWS Watchlist]

Created attachment 335995 [details]
Archive of layout-test-results from ews121 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews121  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[Chris Dumez]

Comment on attachment 335991 [details]
Patch

Darn, a newly added test..

[Chris Dumez]

Created attachment 336048 [details]
Patch

[Chris Dumez]

Created attachment 336052 [details]
Patch

[EWS Watchlist]

Comment on attachment 336052 [details]
Patch

Attachment 336052 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/7026598

New failing tests:
http/tests/security/feed-urls-from-remote.html

[EWS Watchlist]

Created attachment 336061 [details]
Archive of layout-test-results from ews101 for mac-sierra

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews101  Port: mac-sierra  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 336052 [details]
Patch

Attachment 336052 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/7026470

New failing tests:
http/tests/appcache/interrupted-update.html

[EWS Watchlist]

Created attachment 336062 [details]
Archive of layout-test-results from ews122 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews122  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 336052 [details]
Patch

Attachment 336052 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/7026762

New failing tests:
http/tests/security/feed-urls-from-remote.html

[EWS Watchlist]

Created attachment 336065 [details]
Archive of layout-test-results from ews114 for mac-sierra

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews114  Port: mac-sierra  Platform: Mac OS X 10.12.6

[EWS Watchlist]

Comment on attachment 336052 [details]
Patch

Attachment 336052 [details] did not pass win-ews (win):
Output: http://webkit-queues.webkit.org/results/7026953

New failing tests:
http/tests/security/feed-urls-from-remote.html

[EWS Watchlist]

Created attachment 336066 [details]
Archive of layout-test-results from ews200 for win-future

The attached test failures were seen while running run-webkit-tests on the win-ews.
Bot: ews200  Port: win-future  Platform: CYGWIN_NT-6.1-2.9.0-0.318-5-3-x86_64-64bit

[Chris Dumez]

Created attachment 336070 [details]
Patch

[Chris Dumez]

Created attachment 336080 [details]
Patch

[Alex Christensen]

Comment on attachment 336080 [details]
Patch

woo hoo! let's try this again

[WebKit Commit Bot]

Comment on attachment 336080 [details]
Patch

Clearing flags on attachment: 336080

Committed r229726: <https://trac.webkit.org/changeset/229726>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Ryan Haddad]

Added WK2 baselines for some webarchive/loading tests in https://trac.webkit.org/changeset/229763/webkit

[Chris Dumez]

Looks like there are some iOS-specific API test failures.

[Chris Dumez]

(In reply to Chris Dumez from comment #132)
> Looks like there are some iOS-specific API test failures.

Tests that failed:
  DataInteractionTests.AdditionalLinkAndImageIntoContentEditable
  DataInteractionTests.CanStartDragOnDivWithDraggableAttribute
  DataInteractionTests.DoNotCrashWhenSelectionMovesOffscreenAfterDragStart
  DataInteractionTests.DragEventClientCoordinatesBasic
  DataInteractionTests.DragImageFromContentEditable
  DataInteractionTests.DragLiftPreviewDataTransferSetDragImage
  DataInteractionTests.ImageDoesNotUseElementSizeAsEstimatedSize
  DataInteractionTests.ImageToContentEditable
  DataInteractionTests.ImageToTextarea
  DataInteractionTests.InjectedBundleAttachmentElementData
  DataInteractionTests.InjectedBundleImageElementData
  DataInteractionTests.LargeImageToTargetDiv
  ScrollViewInsetTests.RestoreInitialContentOffsetAfterCrash
  WKWebView.SnapshotImageLargeAsyncDecoding

Tests that timed out:
  QuickLook.NavigationDelegate

[Chris Dumez]

Reverted r229726 and r229763 for reason:

Caused some API test failures on iOS

Committed r229764: <https://trac.webkit.org/changeset/229764>

[Chris Dumez]

Reverted r229726 and r229763 for reason:

Caused some API test failures on iOS

Committed r229764: <https://trac.webkit.org/changeset/229764>

[Chris Dumez]

(In reply to Chris Dumez from comment #133)
> (In reply to Chris Dumez from comment #132)
> > Looks like there are some iOS-specific API test failures.
> 
> Tests that failed:
>   DataInteractionTests.AdditionalLinkAndImageIntoContentEditable
>   DataInteractionTests.CanStartDragOnDivWithDraggableAttribute
>   DataInteractionTests.DoNotCrashWhenSelectionMovesOffscreenAfterDragStart
>   DataInteractionTests.DragEventClientCoordinatesBasic
>   DataInteractionTests.DragImageFromContentEditable
>   DataInteractionTests.DragLiftPreviewDataTransferSetDragImage
>   DataInteractionTests.ImageDoesNotUseElementSizeAsEstimatedSize
>   DataInteractionTests.ImageToContentEditable
>   DataInteractionTests.ImageToTextarea
>   DataInteractionTests.InjectedBundleAttachmentElementData
>   DataInteractionTests.InjectedBundleImageElementData
>   DataInteractionTests.LargeImageToTargetDiv
>   ScrollViewInsetTests.RestoreInitialContentOffsetAfterCrash
>   WKWebView.SnapshotImageLargeAsyncDecoding
> 
> Tests that timed out:
>   QuickLook.NavigationDelegate

Looks like fast/loader/javascript-url-iframe-remove-on-navigate-async-delegate.html was flaky too.

[Chris Dumez]

Created attachment 336204 [details]
Patch

[Chris Dumez]

Created attachment 336205 [details]
Patch

[Chris Dumez]

Created attachment 336210 [details]
Patch

[WebKit Commit Bot]

Comment on attachment 336210 [details]
Patch

Clearing flags on attachment: 336210

Committed r229831: <https://trac.webkit.org/changeset/229831>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Ryan Haddad]

Looks like we have another API test issue:

Tests that timed out:
  ProcessSwap.Basic

https://build.webkit.org/builders/Apple%20High%20Sierra%20Release%20WK1%20%28Tests%29/builds/4121

[Ryan Haddad]

Also, fast/loader/javascript-url-iframe-remove-on-navigate-async-delegate.html seems to fail again:

https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/r229832%20(8291)/results.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=fast%2Floader%2Fjavascript-url-iframe-remove-on-navigate-async-delegate.html

[Chris Dumez]

(In reply to Ryan Haddad from comment #143)
> Also,
> fast/loader/javascript-url-iframe-remove-on-navigate-async-delegate.html
> seems to fail again:
> 
> https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/
> r229832%20(8291)/results.html
> https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.
> html#showAllRuns=true&tests=fast%2Floader%2Fjavascript-url-iframe-remove-on-
> navigate-async-delegate.html

Looking.

[Chris Dumez]

(In reply to Ryan Haddad from comment #142)
> Looks like we have another API test issue:
> 
> Tests that timed out:
>   ProcessSwap.Basic
> 
> https://build.webkit.org/builders/
> Apple%20High%20Sierra%20Release%20WK1%20%28Tests%29/builds/4121

This is a new test that was just added by Brady. It looks like it crashes in debug:
SHOULD NEVER BE REACHED
./loader/DocumentLoader.cpp(901) : void WebCore::DocumentLoader::continueAfterContentPolicy(WebCore::PolicyAction)
1   0x7f7aaf68d WTFCrash
2   0x7ea5966d7 WebCore::DocumentLoader::continueAfterContentPolicy(WebCore::PolicyAction)
3   0x7ea5bbc95 WebCore::DocumentLoader::responseReceived(WebCore::ResourceResponse const&, WTF::CompletionHandler<void ()>&&)::$_7::operator()(WebCore::PolicyAction) const
4   0x7ea5bbb2a WTF::Function<void (WebCore::PolicyAction)>::CallableWrapper<WebCore::DocumentLoader::responseReceived(WebCore::ResourceResponse const&, WTF::CompletionHandler<void ()>&&)::$_7>::call(WebCore::PolicyAction)
5   0x104bf45d1 WTF::Function<void (WebCore::PolicyAction)>::operator()(WebCore::PolicyAction) const
6   0x1053a31d7 WebKit::WebFrame::didReceivePolicyDecision(unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID, std::optional<WebKit::WebsitePoliciesData>&&)
7   0x1054cf8dc WebKit::WebPage::didReceivePolicyDecision(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&)
8   0x1055655f7 void IPC::callMemberFunctionImpl<WebKit::WebPage, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&), std::__1::tuple<unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID, std::optional<WebKit::WebsitePoliciesData> >, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul>(WebKit::WebPage*, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&), std::__1::tuple<unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID, std::optional<WebKit::WebsitePoliciesData> >&&, std::__1::integer_sequence<unsigned long, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul>)
9   0x105564610 void IPC::callMemberFunction<WebKit::WebPage, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&), std::__1::tuple<unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID, std::optional<WebKit::WebsitePoliciesData> >, std::__1::integer_sequence<unsigned long, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul> >(std::__1::tuple<unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID, std::optional<WebKit::WebsitePoliciesData> >&&, WebKit::WebPage*, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&))
10  0x1055527cf void IPC::handleMessage<Messages::WebPage::DidReceivePolicyDecision, WebKit::WebPage, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&)>(IPC::Decoder&, WebKit::WebPage*, void (WebKit::WebPage::*)(unsigned long long, unsigned long long, WebCore::PolicyAction, unsigned long long, WebKit::DownloadID const&, std::optional<WebKit::WebsitePoliciesData>&&))
11  0x10554a0c2 WebKit::WebPage::didReceiveWebPageMessage(IPC::Connection&, IPC::Decoder&)
12  0x1054d572e WebKit::WebPage::didReceiveMessage(IPC::Connection&, IPC::Decoder&)
13  0x1054d5774 non-virtual thunk to WebKit::WebPage::didReceiveMessage(IPC::Connection&, IPC::Decoder&)
14  0x104cc3c08 IPC::MessageReceiverMap::dispatchMessage(IPC::Connection&, IPC::Decoder&)
15  0x105720fad WebKit::WebProcess::didReceiveMessage(IPC::Connection&, IPC::Decoder&)
16  0x104bb5943 IPC::Connection::dispatchMessage(IPC::Decoder&)
17  0x104baaf28 IPC::Connection::dispatchMessage(std::__1::unique_ptr<IPC::Decoder, std::__1::default_delete<IPC::Decoder> >)
18  0x104bb5f4a IPC::Connection::dispatchOneMessage()
19  0x104bce3dd IPC::Connection::enqueueIncomingMessage(std::__1::unique_ptr<IPC::Decoder, std::__1::default_delete<IPC::Decoder> >)::$_14::operator()()
20  0x104bce339 WTF::Function<void ()>::CallableWrapper<IPC::Connection::enqueueIncomingMessage(std::__1::unique_ptr<IPC::Decoder, std::__1::default_delete<IPC::Decoder> >)::$_14>::call()
21  0x7f7ad42eb WTF::Function<void ()>::operator()() const
22  0x7f7b25b73 WTF::RunLoop::performWork()
23  0x7f7b26474 WTF::RunLoop::performWork(void*)
24  0x7fff39862a61 __CFRUNLOOP_IS_CALLING_OUT_TO_A_SOURCE0_PERFORM_FUNCTION__
25  0x7fff3991c47c __CFRunLoopDoSource0
26  0x7fff398454c0 __CFRunLoopDoSources0
27  0x7fff3984493d __CFRunLoopRun
28  0x7fff398441a3 CFRunLoopRunSpecific
29  0x7fff38b2cd96 RunCurrentEventLoopInMode
30  0x7fff38b2ca0f ReceiveNextEventCommon
31  0x7fff38b2c884 _BlockUntilNextEventMatchingListInModeWithFilter

[Chris Dumez]

Comment on attachment 336210 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=336210&action=review

> Source/WebKit/UIProcess/WebPageProxy.cpp:-2377
> -        return;

My patch conflicted with Brady's and I do not think I resolved the conflict correctly. It seems we used to return early here if we were deciding a policy for a response. Therefore, Brady's code below would only be called for for navigation policy decisions. However, now it is called for both :(

[Chris Dumez]

(In reply to Ryan Haddad from comment #142)
> Looks like we have another API test issue:
> 
> Tests that timed out:
>   ProcessSwap.Basic
> 
> https://build.webkit.org/builders/
> Apple%20High%20Sierra%20Release%20WK1%20%28Tests%29/builds/4121

I have a patch for this one at https://bugs.webkit.org/show_bug.cgi?id=183884.

[Chris Dumez]

(In reply to Ryan Haddad from comment #143)
> Also,
> fast/loader/javascript-url-iframe-remove-on-navigate-async-delegate.html
> seems to fail again:
> 
> https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/
> r229832%20(8291)/results.html
> https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.
> html#showAllRuns=true&tests=fast%2Floader%2Fjavascript-url-iframe-remove-on-
> navigate-async-delegate.html

Will deal with this via https://bugs.webkit.org/show_bug.cgi?id=183885.

(In reply to Alex Christensen from comment #0)
> Make policy decisions asynchronous

Can someone please explain what this means?

The reason I’m puzzled is that in the WebKit API, clients have always been able to make policy decisions asynchronously (in the legacy API, using a WebPolicyDecisionListener, in the modern API, using a decision handler block), and the web view has always remained responsive and interactive while waiting for the client to make its decision.

So it doesn’t sound like “make policy decisions asynchronous” refers to new API or new behavior of the existing API. What is it about, then?

Thanks!

[Chris Dumez]

(In reply to mitz from comment #149)
> (In reply to Alex Christensen from comment #0)
> > Make policy decisions asynchronous
> 
> Can someone please explain what this means?
> 
> The reason I’m puzzled is that in the WebKit API, clients have always been
> able to make policy decisions asynchronously (in the legacy API, using a
> WebPolicyDecisionListener, in the modern API, using a decision handler
> block), and the web view has always remained responsive and interactive
> while waiting for the client to make its decision.
> 
> So it doesn’t sound like “make policy decisions asynchronous” refers to new
> API or new behavior of the existing API. What is it about, then?
> 
> Thanks!

I responded on the other bug you commented on.