Bug 227369 - [ iOS16 Big Sur wk2] http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html is a flakey failure
Summary: [ iOS16 Big Sur wk2] http/tests/privateClickMeasurement/store-private-click-m...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac (Intel) macOS 11
: P2 Normal
Assignee: Charlie Wolfe
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-06-24 11:34 PDT by Kevin Neal
Modified: 2023-05-08 17:56 PDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Kevin Neal 2021-06-24 11:34:06 PDT
http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html

This test is a flakey failure on Big Sur wk 2. This test has an infrequent failure in history.


History:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fstore-private-click-measurement-with-source-nonce.html

Diff:

--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-actual.txt
@@ -13,25 +13,19 @@
 Request body:
 
 REQUEST_METHOD: POST
-HTTP_HOST: 127.0.0.1:8000
+HTTP_HOST: localhost:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_nonce":"ABCDEFabcdef0123456789","source_unlinkable_token":"unlinkableToken","version":2}
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2}
 REQUEST_METHOD: POST
 HTTP_HOST: 127.0.0.1:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2,"source_secret_token":"secretToken","source_secret_token_signature":"signature"}
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":2}
 
 
 No stored Private Click Measurement data.
Comment 1 Radar WebKit Bug Importer 2021-06-24 11:34:55 PDT
<rdar://problem/79734449>
Comment 2 Kevin Neal 2021-06-24 15:09:44 PDT
I was able to reproduce this failure using command:
run-webkit-tests http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html --iterations 500 -f
Comment 3 Hercules Hjalmarsson 2022-07-13 15:03:42 PDT
http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html

This test appears to still be a flaky failure both on macOS Big Sur wk2 and iOS15 wk2 Debug on ToT. Unable to update bug title to include iOS15 wk2 Debug.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fstore-private-click-measurement-with-source-nonce.html

DIFF:
--- /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-actual.txt
@@ -6,32 +6,18 @@
 Frame: '<!--frame1-->'
 --------
 Token signing request received.
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-
 REQUEST_METHOD: POST
 HTTP_HOST: 127.0.0.1:8000
 Content type: application/json
 REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
 No cookies in token signing request.
 Request body:
-{"source_engagement_type":"click","source_nonce":"ABCDEFabcdef0123456789","source_unlinkable_token":"unlinkableToken","version":3}
-REQUEST_METHOD: GET
-HTTP_HOST: 127.0.0.1:8000
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
+{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":3}
 
-REQUEST_METHOD: POST
-HTTP_HOST: 127.0.0.1:8000
-Content type: application/json
-REQUEST_URI: /privateClickMeasurement/resources/fraudPreventionTestURL.py
-No cookies in token signing request.
-Request body:
-{"source_engagement_type":"click","source_site":"127.0.0.1","source_id":3,"attributed_on_site":"localhost","trigger_data":12,"version":3,"source_secret_token":"secretToken","source_secret_token_signature":"signature"}
-
-
-No stored Private Click Measurement data.
+Unattributed Private Click Measurements:
+WebCore::PrivateClickMeasurement 1
+Source site: 127.0.0.1
+Attribute on site: localhost
+Source ID: 3
+No attribution trigger data.
+Application bundle identifier: org.webkit.WebKitTestRunnerApp

DIFF URL:
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/252318@main%20(2098)/http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce-pretty-diff.html
Comment 4 Hercules Hjalmarsson 2022-07-13 15:06:51 PDT
I was able to reproduce the flaky failure on iOS15 wk2 debug ToT running 1000 iterations using command:

run-webkit-tests http/tests/privateClickMeasurement/store-private-click-measurement-with-source-nonce.html -f -force
Comment 5 Hercules Hjalmarsson 2022-07-13 15:37:53 PDT
Pull request: https://github.com/WebKit/WebKit/pull/2387
Comment 6 EWS 2022-07-13 15:40:21 PDT
Test gardening commit 252426@main (b7ab8305062a): <https://commits.webkit.org/252426@main>

Reviewed commits have been landed. Closing PR #2387 and removing active labels.
Comment 7 EWS 2022-10-13 09:42:59 PDT
Test gardening commit 255485@main (6e0d07eeac09): <https://commits.webkit.org/255485@main>

Reviewed commits have been landed. Closing PR #5332 and removing active labels.
Comment 8 Charlie Wolfe 2023-05-08 17:43:29 PDT
Pull request: https://github.com/WebKit/WebKit/pull/13615
Comment 9 EWS 2023-05-08 17:56:32 PDT
Test gardening commit 263842@main (ea44bfdc26ef): <https://commits.webkit.org/263842@main>

Reviewed commits have been landed. Closing PR #13615 and removing active labels.