REGRESSION(r292107): [ Mac iOS ] http/tests/paymentrequest/updateWith-shippingOptions.https.html is a constant text failure

[Dawn Morningstar]

http/tests/paymentrequest/updateWith-shippingOptions.https.html
Is a constant text failure on all all queues.

regression appears to be r292107, but its notable that r291811 was also a regression for this test; causing a constant failure on Monterey specifically.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fpaymentrequest%2FupdateWith-shippingOptions.https.html

DIFF:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/webAPIStatistics/canvas-read-and-write-data-collection-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/webAPIStatistics/canvas-read-and-write-data-collection-actual.txt
@@ -9,3 +9,11 @@
     isPrevalentResource: No
     isVeryPrevalentResource: No
     dataRecordsRemoved: 0
+Registrable domain: nullOrigin
+    hadUserInteraction: No
+    mostRecentUserInteraction: -1
+    grandfathered: No
+    IsScheduledForAllButCookieDataRemoval: No
+    isPrevalentResource: No
+    isVeryPrevalentResource: No
+    dataRecordsRemoved: 0

DIFF-URL:
https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r292107%20(8585)/http/tests/webAPIStatistics/canvas-read-and-write-data-collection-diff.txt

[Radar WebKit Bug Importer]

<rdar://problem/91074265>

[zalan]

I am puzzled by this regression point and if it truly regressed at r291811, then the original author should change the test so that it's not sensitive to a text measuring change like this.

[Devin Rousso]

yeah im not sure how this relates to r291811 at all

i think r292107 is really the cause

[Devin Rousso]

Created attachment 456259 [details]
[fast-cq] Patch

[Dawn Morningstar]

Noticed this DIFF is incorrect.

Must have clicked an incorrect link.

Correct DIFF:

--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/paymentrequest/updateWith-shippingOptions.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/paymentrequest/updateWith-shippingOptions.https-actual.txt
@@ -1,5 +1,5 @@
 CONSOLE MESSAGE: WebKit currently uses the first shipping option even if other shipping options are marked as selected.
 
 PASS Calling `updateWith` with a new `shippingOptions` without `requestShipping` should not update any values.
-FAIL Calling `updateWith` with a new `shippingOptions` should not update any other values. assert_equals: selected shipping option should change expected "shippingId4" but got "shippingId3"
+FAIL Calling `updateWith` with a new `shippingOptions` should not update any other values. assert_equals: shipping option 0 selected should change expected (boolean) false but got (undefined) undefined
 

Correct DIFF URL:
https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r292156%20(8603)/http/tests/paymentrequest/updateWith-shippingOptions.https-diff.txt

[Dawn Morningstar]

(In reply to Devin Rousso from comment #3)
> yeah im not sure how this relates to r291811 at all
> 
> i think r292107 is really the cause

I think r292107 is the real cause as well, but I did notice looking at the history, a strange failure after r291811.

[Chris Dumez]

Comment on attachment 456259 [details]
[fast-cq] Patch

Clearing flags on attachment: 456259

Committed r292173 (249080@trunk): <https://commits.webkit.org/249080@trunk>

[Chris Dumez]

All reviewed patches have been landed.  Closing bug.

[Dawn Morningstar]

*** Bug 238908 has been marked as a duplicate of this bug. ***