Bug 238908 – REBASLINE: [ Monterey wk2 ] 7 /paymentrequest/* tests are constant text failures

• Status: REOPENED
• Component: New Bugs

[Dawn Morningstar]

http/tests/inspector/paymentrequest/payment-request-internal-properties.https.html
is a constant text failure on Monterey wk2 queues.

Regression point appears to be r291811

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Finspector%2Fpaymentrequest%2Fpayment-request-internal-properties.https.html

DIFF:
--- /Volumes/Data/worker/monterey-release-tests-wk2/build/layout-test-results/http/tests/inspector/paymentrequest/payment-request-internal-properties.https-expected.txt
+++ /Volumes/Data/worker/monterey-release-tests-wk2/build/layout-test-results/http/tests/inspector/paymentrequest/payment-request-internal-properties.https-actual.txt
@@ -1,4 +1,3 @@
-CONSOLE MESSAGE: WebKit currently uses the first shipping option even if other shipping options are marked as selected.
 Internal properties of a PaymentRequest.
 
 
DIFF-URL:
https://build.webkit.org/results/Apple-Monterey-Release-WK2-Tests/r291811%20(791)/http/tests/inspector/paymentrequest/payment-request-internal-properties.https-diff.txt

[Radar WebKit Bug Importer]

<rdar://problem/91382499>

[Dawn Morningstar]

When attempting to reproduce using run-webkit-tests:
Failure continues to happen at Monterey TOT

[Dawn Morningstar]

Regression point may not be r291811 as history suggests. 

When attempting to reproduce with run-webkit-tests issue continues far before r291811...

[Dawn Morningstar]

*** This bug has been marked as a duplicate of bug 238581 ***

[Dawn Morningstar]

Reopening to manually resolve upstreaming issues.

[Dawn Morningstar]

http/tests/paymentrequest/payment-address-attributes-and-toJSON-method.https.html
http/tests/inspector/paymentrequest/payment-request-internal-properties.https.html 
http/tests/paymentrequest/payment-request-change-shipping-option.https.html
http/tests/paymentrequest/payment-response-retry-method.https.html
http/tests/paymentrequest/updateWith-shippingOptions.https.html 

All appear to be suffering the same failure. Committing rebasline.

[Dawn Morningstar]

Committed rebalance for 4/5 of these tests here:
r292672

updateWith-shippingOptions.https.html may need a fix and a rebasline as it appears to be an actual failing test.

[Dawn Morningstar]

(In reply to Matteo Flores from comment #7)
> Committed rebalance for 4/5 of these tests here:
> r292672
> 
> updateWith-shippingOptions.https.html may need a fix and a rebasline as it
> appears to be an actual failing test.

Rebasline failed as baseline was correct for Big Sur, I will correct this.

[Dawn Morningstar]

r292720 committed expectations until rebasline can be sorted.

[Dawn Morningstar]

These two tests also appear to be related to the payment-request failures:

imported/w3c/web-platform-tests/payment-request/payment-request-constructor.https.sub.html
imported/w3c/web-platform-tests/payment-request/payment-request-shippingOption-attribute.https.html

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fpayment-request%2Fpayment-request-constructor.https.sub.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fpayment-request%2Fpayment-request-shippingOption-attribute.https.html

[Dawn Morningstar]

This expectation update should resolve the console message: r292831, rebasline may still be needed afterward. Awaiting test results.

[Dawn Morningstar]

Tests are nearly resolved. They were previously unintentionally activated on wk1. Issue has been fixed and last step is rebasline for Monterey.

[Dawn Morningstar]

(In reply to Matteo Flores from comment #12)
> Tests are nearly resolved. They were previously unintentionally activated on
> wk1. Issue has been fixed and last step is rebasline for Monterey.

Fixed expectations: r292897

[Dawn Morningstar]

Completed more rebaslines here: r292933