Bug 227369 – [ iOS16 Big Sur wk2] http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html is a flakey failure

• Status: NEW
• Component: New Bugs

[Kevin Neal]

http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html

This test is a flakey failure on Big Sur wk 2. This test has an infrequent failure in history.


History:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fstore-private-click-measurement-with-source-nonce.html

Diff:

--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-actual.txt
@@ -13,25 +13,19 @@
 Request body:
 
 REQUEST_METHOD: POST
-HTTP_HOST: 127.0.0.1:8000
+HTTP_HOST: localhost:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_nonce":"ABCDEFabcdef0123456789","source_unlinkable_token":"unlinkableToken","version":2}
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2}
 REQUEST_METHOD: POST
 HTTP_HOST: 127.0.0.1:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2,"source_secret_token":"secretToken","source_secret_token_signature":"signature"}
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2}
 
 
 No stored Private Click Measurement data.

[Radar WebKit Bug Importer]

<rdar://problem/79734449>

[Kevin Neal]

I was able to reproduce this failure using command:
run-webkit-tests http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html --iterations 500 -f

[Hercules Hjalmarsson]

http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html

This test appears to still be a flaky failure both on macOS Big Sur wk2 and iOS15 wk2 Debug on ToT. Unable to update bug title to include iOS15 wk2 Debug.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fstore-private-click-measurement-with-source-nonce.html

DIFF:
--- /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-actual.txt
@@ -6,32 +6,18 @@
 Frame: '<!--frame1-->'
 --------
 Token signing request received.
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-
 REQUEST_METHOD: POST
 HTTP_HOST: 127.0.0.1:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_nonce":"ABCDEFabcdef0123456789","source_unlinkable_token":"unlinkableToken","version":3}
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":3}
 
-REQUEST_METHOD: POST
-HTTP_HOST: 127.0.0.1:8000
-Content type: application/json
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":3,"source_secret_token":"secretToken","source_secret_token_signature":"signature"}
-
-
-No stored Private Click Measurement data.
+Unattributed Private Click Measurements:
+WebCore::PrivateClickMeasurement 1
+Source site: 127.0.0.1
+Attribute on site: localhost
+Source ID: 3
+No attribution trigger data.
+Application bundle identifier: org.webkit.WebKitTestRunnerApp

DIFF URL:
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/252318@main%20(2098)/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-pretty-diff.html

[Hercules Hjalmarsson]

I was able to reproduce the flaky failure on iOS15 wk2 debug ToT running 1000 iterations using command:

run-webkit-tests http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html -f -force

[Hercules Hjalmarsson]

Pull request: https://github.com/WebKit/WebKit/pull/2387

[EWS]

Test gardening commit 252426@main (b7ab8305062a): <https://commits.webkit.org/252426@main>

Reviewed commits have been landed. Closing PR #2387 and removing active labels.

[EWS]

Test gardening commit 255485@main (6e0d07eeac09): <https://commits.webkit.org/255485@main>

Reviewed commits have been landed. Closing PR #5332 and removing active labels.

[Charlie Wolfe]

Pull request: https://github.com/WebKit/WebKit/pull/13615

[EWS]

Test gardening commit 263842@main (ea44bfdc26ef): <https://commits.webkit.org/263842@main>

Reviewed commits have been landed. Closing PR #13615 and removing active labels.