Bug 195027 - [ Mac WK2] REGRESSION (r206809?) Layout Test http/tests/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report.php is flaky timeout
Summary: [ Mac WK2] REGRESSION (r206809?) Layout Test http/tests/security/contentSecur...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-02-25 17:34 PST by Shawn Roberts
Modified: 2019-04-19 17:09 PDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Shawn Roberts 2019-02-25 17:34:27 PST
The following layout test is failing on Mac WK2

http/tests/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report.php

Probable cause:

Test only recently started showing up on the dashboard. Through testing I can get it to reproduce as a flaky timeout on several revisions all the way back to 228049 which is the oldest revision I can spade. 
Test appears to have been changed in r206809

Reproducible with:

run-webkit-tests http/tests/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report.php --iterations 5000 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fsecurity%2FcontentSecurityPolicy%2Freport-blocked-uri-and-do-not-follow-redirect-when-sending-report.php

Diff: 

--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/tests/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/tests/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report-actual.txt
@@ -1,9 +1,6 @@
 CONSOLE MESSAGE: [Report Only] Refused to load http://127.0.0.1:8000/security/resources/abe.png because it does not appear in the img-src directive of the Content Security Policy.
-CSP report received:
-CONTENT_TYPE: application/csp-report
-HTTP_HOST: 127.0.0.1:8000
-HTTP_REFERER: http://127.0.0.1:8000/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report.php
-REQUEST_METHOD: POST
-REQUEST_URI: /security/contentSecurityPolicy/resources/save-report-and-redirect-to-save-report.php
-=== POST DATA ===
-{"csp-report":{"document-uri":"http://127.0.0.1:8000/security/contentSecurityPolicy/report-blocked-uri-and-do-not-follow-redirect-when-sending-report.php","referrer":"","violated-directive":"img-src 'none'","effective-directive":"img-src","original-policy":"img-src 'none'; report-uri resources/save-report-and-redirect-to-save-report.php","blocked-uri":"http://127.0.0.1:8000/security/resources/abe.png","status-code":200}}
+#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 35312)
+FAIL: Timed out waiting for notifyDone to be called
+
+#EOF
+#EOF
Comment 1 Radar WebKit Bug Importer 2019-02-25 17:38:21 PST
<rdar://problem/48385557>
Comment 2 Alexey Proskuryakov 2019-02-26 10:38:57 PST
> -REQUEST_URI: /security/contentSecurityPolicy/resources/save-report-and-redirect-to-save-report.php

Not sure if this test can legitimately run in parallel, so the repro may not be valid. Still a regression though.
Comment 3 Shawn Roberts 2019-03-08 13:05:32 PST
I believe you are right. I went through and tried some additional troubleshooting and could not reproduce the failure with 1000 iterations and only 1 child process.

I also tried running the test runners from the build for both of the timeouts on the dashboard and am still unable to reproduce it with either the full test runner, or just the tests preceding this test and cannot get reproductions.
Comment 4 Ryosuke Niwa 2019-04-19 17:09:11 PDT
Looks like it has been passing just fine lately.