Bug 226826

Summary: REGRESSION (r278630?): [Monterey iOS 14+ ] http/tests/ssl/applepay/ApplePayButton.html is a constant failure
Product: WebKit Reporter: Amir Mark Jr <amir_mark>
Component: New BugsAssignee: Devin Rousso <hi>
Status: NEW    
Severity: Normal CC: aestes, benjamin, cdumez, cmarcelo, ews-watchlist, hi, jenner, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Patch ews-feeder: commit-queue-

Amir Mark Jr
Reported 2021-06-09 10:09:15 PDT
http/tests/ssl/applepay/ApplePayButton.html Is a constant failure on iOS 14 E Simulator wk2 Debug and Release. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fssl%2Fapplepay%2FApplePayButton.html Text Diff: --- /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayButton-expected.txt +++ /Volumes/Data/worker/ios-simulator-14-release-tests-wk2/build/layout-test-results/http/tests/ssl/applepay/ApplePayButton-actual.txt @@ -39,45 +39,45 @@ PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white") is true -PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType +FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain. +PASS CSS.supports("-apple-pay-button-style: white") is true +FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain. PASS CSS.supports("-apple-pay-button-style: white-outline") is true PASS CSS.supports("-apple-pay-button-type: plain") is supportsVersion PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" @@ -114,45 +114,45 @@ PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: white-outline") is true -PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType +FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain. +PASS CSS.supports("-apple-pay-button-style: white-outline") is true +FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain. PASS CSS.supports("-apple-pay-button-style: black") is true PASS CSS.supports("-apple-pay-button-type: plain") is supportsVersion PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" @@ -189,45 +189,45 @@ PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: reload") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: add-money") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: top-up") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: order") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: rent") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: support") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: contribute") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType -PASS CSS.supports("-apple-pay-button-style: black") is true -PASS CSS.supports("-apple-pay-button-type: tip") is supportsVersion -PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" -PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle -PASS computedStyle.getPropertyValue("-apple-pay-button-type") is expectedType +FAIL CSS.supports("-apple-pay-button-type: reload") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be reload. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: add-money") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be add-money. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: top-up") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be top-up. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: order") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be order. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: rent") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be rent. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: support") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be support. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: contribute") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be contribute. Was plain. +PASS CSS.supports("-apple-pay-button-style: black") is true +FAIL CSS.supports("-apple-pay-button-type: tip") should be true. Was false. +PASS computedStyle.getPropertyValue("-webkit-appearance") is "-apple-pay-button" +PASS computedStyle.getPropertyValue("-apple-pay-button-style") is expectedStyle +FAIL computedStyle.getPropertyValue("-apple-pay-button-type") should be tip. Was plain. PASS successfullyParsed is true TEST COMPLETE
Attachments
Patch (1.42 KB, patch)
2021-06-09 14:15 PDT, Devin Rousso 		ews-feeder: commit-queue-
DetailsFormatted DiffDiff
View All Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2021-06-09 10:10:40 PDT
<rdar://problem/79083892>
Amir Mark Jr
Comment 2 2021-06-09 13:44:23 PDT
Unable to reproduce issue. The spades available are only r278629 and r278644. It's possible that the regression point is related to r278630: https://trac.webkit.org/changeset/278630/webkit This changeset deals with Apple Pay, but unable to test due to spade not being available to test.
Devin Rousso
Comment 3 2021-06-09 14:15:05 PDT
Created attachment 431009 [details] Patch
Amir Mark Jr
Comment 4 2021-06-09 14:46:00 PDT
Updated test expectations while EWS updates: https://trac.webkit.org/changeset/278676/webkit
Alexey Proskuryakov
Comment 5 2021-06-11 19:37:06 PDT
Comment on attachment 431009 [details] Patch View in context: https://bugs.webkit.org/attachment.cgi?id=431009&action=review > Source/WTF/wtf/PlatformHave.h:718 > +#if (PLATFORM(MAC) && __MAC_OS_X_VERSION_MIN_REQUIRED >= 110000) || (PLATFORM(IOS) && __IPHONE_OS_VERSION_MIN_REQUIRED >= 140000) This bug was reported on iOS 14, and this check doesn't affect what happens there.
Robert Jenner
Comment 6 2021-11-29 16:46:10 PST
The same failure also appears to be occurring on Monterey as well: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fssl%2Fapplepay%2FApplePayButton.html
Robert Jenner
Comment 7 2021-11-30 13:31:57 PST
I have added Failure expectations here: https://trac.webkit.org/changeset/286322/webkit
Note You need to log in before you can comment on or make changes to this bug.