Bug 190650 - [macOS Debug WK2] Layout Test http/tests/ssl/applepay/ApplePayShippingAddressChangeEventErrorsV3.https.html is a flaky failure
Summary: [macOS Debug WK2] Layout Test http/tests/ssl/applepay/ApplePayShippingAddress...
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Andy Estes
Keywords: InRadar
Depends on:
Reported: 2018-10-16 16:09 PDT by Ryan Haddad
Modified: 2018-10-24 07:15 PDT (History)
14 users (show)

See Also:

Patch (4.16 KB, patch)
2018-10-17 16:02 PDT, Andy Estes
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2018-10-16 16:09:03 PDT
The following layout test is flaky on Mojave and High Sierra Debug WK2


Probable cause:

It looks like this test has been flaky since it was added in https://trac.webkit.org/changeset/236552/webkit

Flakiness Dashboard:


--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayShippingAddressChangeEventErrorsV3.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayShippingAddressChangeEventErrorsV3.https-actual.txt
@@ -1,3 +1,5 @@
+CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
+CONSOLE MESSAGE: Unhandled Promise Rejection: TypeError: Type error
 Test specifying Apple Pay errors in response to the shippingaddresschange event.
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
Comment 1 Ryan Haddad 2018-10-16 16:14:23 PDT
I can reproduce the failure with the following:

run-webkit-tests --debug http/tests/ssl/applepay/ApplePayShippingAddressChangeEventErrorsV3.https.html -fg --iter 20 --no-retry
Comment 2 Radar WebKit Bug Importer 2018-10-17 10:13:00 PDT
Comment 3 Andy Estes 2018-10-17 16:02:56 PDT
Created attachment 352659 [details]
Comment 4 WebKit Commit Bot 2018-10-24 07:15:22 PDT
Comment on attachment 352659 [details]

Clearing flags on attachment: 352659

Committed r237381: <https://trac.webkit.org/changeset/237381>
Comment 5 WebKit Commit Bot 2018-10-24 07:15:23 PDT
All reviewed patches have been landed.  Closing bug.