Bug 226826

Summary: REGRESSION (r278630?): [Monterey iOS 14+ ] http/tests/ssl/applepay/ApplePayButton.html is a constant failure
Product: WebKit Reporter: Amir Mark Jr <amir_mark>
Component: New BugsAssignee: Devin Rousso <hi>
Status: NEW ---    
Severity: Normal CC: aestes, benjamin, cdumez, cmarcelo, ews-watchlist, hi, jenner, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Patch ews-feeder: commit-queue-

Description Amir Mark Jr 2021-06-09 10:09:15 PDT
http/tests/ssl/applepay/ApplePayButton.html

Is a constant failure on iOS 14 E Simulator wk2 Debug and Release.


History:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fssl%2Fapplepay%2FApplePayButton.html


Text Diff:

--- /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayButton-expected.txt
+++ /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayButton-actual.txt
@@ -39,45 +39,45 @@
 PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
 PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
 PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white") is true
-PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
+FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white") is true
+FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain.
 PASS CSS.supports("-apple-pay-button-style: white-outline") is true
 PASS CSS.supports("-apple-pay-button-type: plain") is supportsVersion
 PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
@@ -114,45 +114,45 @@
 PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
 PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
 PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: white-outline") is true
-PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
+FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain.
+PASS CSS.supports("-apple-pay-button-style: white-outline") is true
+FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain.
 PASS CSS.supports("-apple-pay-button-style: black") is true
 PASS CSS.supports("-apple-pay-button-type: plain") is supportsVersion
 PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
@@ -189,45 +189,45 @@
 PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
 PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
 PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
-PASS CSS.supports("-apple-pay-button-style: black") is true
-PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion
-PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
-PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
-PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType
+FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain.
+PASS CSS.supports("-apple-pay-button-style: black") is true
+FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false.
+PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button"
+PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle
+FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain.
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 1 Radar WebKit Bug Importer 2021-06-09 10:10:40 PDT
<rdar://problem/79083892>
Comment 2 Amir Mark Jr 2021-06-09 13:44:23 PDT
Unable to reproduce issue. The spades available are only r278629 and r278644. 

It's possible that the regression point is related to r278630: https://trac.webkit.org/changeset/278630/webkit

This changeset deals with Apple Pay, but unable to test due to spade not being available to test.
Comment 3 Devin Rousso 2021-06-09 14:15:05 PDT
Created attachment 431009 [details]
Patch
Comment 4 Amir Mark Jr 2021-06-09 14:46:00 PDT
Updated test expectations while EWS updates:

https://trac.webkit.org/changeset/278676/webkit
Comment 5 Alexey Proskuryakov 2021-06-11 19:37:06 PDT
Comment on attachment 431009 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=431009&action=review

> Source/WTF/wtf/PlatformHave.h:718
> +#if (PLATFORM(MAC) && __MAC_OS_X_VERSION_MIN_REQUIRED >= 110000) || (PLATFORM(IOS) && __IPHONE_OS_VERSION_MIN_REQUIRED >= 140000)

This bug was reported on iOS 14, and this check doesn't affect what happens there.
Comment 6 Robert Jenner 2021-11-29 16:46:10 PST
The same failure also appears to be occurring on Monterey as well:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fssl%2Fapplepay%2FApplePayButton.html
Comment 7 Robert Jenner 2021-11-30 13:31:57 PST
I have added Failure expectations here:

https://trac.webkit.org/changeset/286322/webkit