206834 2020-01-27 10:28:38 -0800 [ Macos iOS ] http/tests/workers/service/basic-timeout.https.html is flaky failing 2024-01-04 18:44:16 -0800 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 jacob_uphoff webkit-unassigned fujii tsavell webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1611469 0 jacob_uphoff 2020-01-27 10:28:38 -0800 http/tests/workers/service/basic-timeout.https.html is flakey failing on macOS and iOS I was able to reproduce the failure by running the test in iterations x5000, it reproduced multiple times. The test has been flaky for the whole visible history, so no regression point. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fworkers%2Fservice%2Fbasic-timeout.https.html&platform=ios&platform=mac Diff: --- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/http/tests/workers/service/basic-timeout.https-expected.txt +++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/http/tests/workers/service/basic-timeout.https-actual.txt @@ -2,9 +2,9 @@ URL 0 - https://127.0.0.1:8443/workers/service/resources/timeout-fallback.html Status code 0 - 200 Source' header 0 - null -URL 1 - https://127.0.0.1:8443/workers/service/resources/timeout-no-fallback.html -Status code 1 - 404 -Source' header 1 - null +URL 1 - undefined +Status code 1 - undefined +Source' header 1 - undefined URL 2 - https://127.0.0.1:8443/workers/service/resources/succeed-fallback-check.php Status code 2 - 200 Source' header 2 - network 1611471 1 webkit-bug-importer 2020-01-27 10:31:51 -0800 <rdar://problem/58923921> 1611539 2 388887 jacob_uphoff 2020-01-27 13:09:19 -0800 Created attachment 388887 Update TestExpectations 1611554 3 388887 tsavell 2020-01-27 13:25:16 -0800 Comment on attachment 388887 Update TestExpectations Clearing flags on attachment: 388887 Committed r255164: <https://trac.webkit.org/changeset/255164> 2003085 4 fujii 2024-01-04 18:41:16 -0800 It is still a flaky failure. 253540@main changed the test. There are current failure diffs. Buildbot: builder Apple-Ventura-Release-AppleSilicon-WK2-Tests build 6816 : 272652@main https://build.webkit.org/#/builders/699/builds/6816 https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/272652@main%20(6816)/http/tests/workers/service/basic-timeout.https-diff.txt --- /Volumes/Data/worker/Apple-Ventura-Release-AppleSilicon-WK2-Tests/build/layout-test-results/http/tests/workers/service/basic-timeout.https-expected.txt +++ /Volumes/Data/worker/Apple-Ventura-Release-AppleSilicon-WK2-Tests/build/layout-test-results/http/tests/workers/service/basic-timeout.https-actual.txt @@ -5,9 +5,13 @@ PASS frameText(testFrame1) is "Timeout resource fetched from network" PASS frameText(testFrame2) is "Not Found" +FAIL frameText(testFrame3) should be Success!. Was . +PASS frameText(testFrame1) is "Timeout resource fetched from network" +PASS frameText(testFrame2) is "Not Found" PASS frameText(testFrame3) is "Success!" -PASS frameText(testFrame4) is "Success!" +FAIL frameText(testFrame4) should be Success!. Was . PASS successfullyParsed is true +Some tests failed. TEST COMPLETE Buildbot: builder Apple-iOS-17-Simulator-Release-WK2-Tests build 1262 : 272498@main https://build.webkit.org/#/builders/925/builds/1262 https://build.webkit.org/results/Apple-iOS-17-Simulator-Release-WK2-Tests/272498@main%20(1262)/http/tests/workers/service/basic-timeout.https-diff.txt --- /Volumes/Data/worker/Apple-iOS-17-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/workers/service/basic-timeout.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-17-Simulator-Release-WK2-Tests/build/layout-test-results/http/tests/workers/service/basic-timeout.https-actual.txt @@ -6,8 +6,9 @@ PASS frameText(testFrame1) is "Timeout resource fetched from network" PASS frameText(testFrame2) is "Not Found" PASS frameText(testFrame3) is "Success!" -PASS frameText(testFrame4) is "Success!" +FAIL frameText(testFrame4) should be Success!. Threw exception TypeError: null is not an object (evaluating 'testFrame.contentDocument.body.innerText') PASS successfullyParsed is true +Some tests failed. TEST COMPLETE 2003086 5 fujii 2024-01-04 18:44:16 -0800 WPE and WinCairo ports are also flaky failures. History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fworkers%2Fservice%2Fbasic-timeout.https.html 388887 2020-01-27 13:09:19 -0800 2020-01-27 17:09:30 -0800 Update TestExpectations bug-206834-20200127130919.patch text/plain 2105 jacob_uphoff U3VidmVyc2lvbiBSZXZpc2lvbjogMjU1MTYyCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggYzNkMWIwYWY5MGJjYmE4NWIyNmFl NzhhMmU5MzQyNzMxODc5YzdiYS4uZDkxZmI5NmVmMTA5OTFjY2FkMTdlYzFiYTRiNTA2YzMzZjBh MTcxNiAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEzIEBACisyMDIwLTAxLTI3ICBKYWNvYiBVcGhvZmYgIDxq YWNvYl91cGhvZmZAYXBwbGUuY29tPgorCisgICAgICAgIFsgTWFjb3MgaU9TIF0gaHR0cC90ZXN0 cy93b3JrZXJzL3NlcnZpY2UvYmFzaWMtdGltZW91dC5odHRwcy5odG1sIGlzIGZsYWt5IGZhaWxp bmcKKyAgICAgICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTIwNjgz NAorCisgICAgICAgIFVucmV2aWV3ZWQgdGVzdCBnYXJkZW5pbmcuCisKKyAgICAgICAgKiBwbGF0 Zm9ybS9pb3MvVGVzdEV4cGVjdGF0aW9uczoKKyAgICAgICAgKiBwbGF0Zm9ybS9tYWMtd2syL1Rl c3RFeHBlY3RhdGlvbnM6CisKIDIwMjAtMDEtMjcgIEplciBOb2JsZSAgPGplci5ub2JsZUBhcHBs ZS5jb20+CiAKICAgICAgICAgU3VwcG9ydCAnYWxsb3c9ImZ1bGxzY3JlZW4iJyBmZWF0dXJlIHBv bGljeQpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vaW9zL1Rlc3RFeHBlY3RhdGlv bnMgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9pb3MvVGVzdEV4cGVjdGF0aW9ucwppbmRleCAxMmI0 MDdhM2MzYmJmNjdiZDgwM2EwNzk3ZTlkZWViMjYwY2JkYTBlLi5mMzY2OGYxOWFmM2ZhZmI2ZjQz MDYxYzE0MDUxMGVmYjJhMzIwZTE5IDEwMDY0NAotLS0gYS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9p b3MvVGVzdEV4cGVjdGF0aW9ucworKysgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9pb3MvVGVzdEV4 cGVjdGF0aW9ucwpAQCAtMzQ2MywzICszNDYzLDQgQEAgd2Via2l0Lm9yZy9iLzIwNjI5MSBzdG9y YWdlL3dlYnNxbC9zdGF0ZW1lbnQtZXJyb3ItY2FsbGJhY2suaHRtbCBbIFBhc3MgVGltZW91dAog CiB3ZWJraXQub3JnL2IvMjAzMjIyIHN2Zy93aWNkL3JpZ2h0c2l6aW5nLWdyaWQueGh0bWwgWyBQ YXNzIEZhaWx1cmUgXQogCit3ZWJraXQub3JnL2IvMjA2ODY0IGh0dHAvdGVzdHMvd29ya2Vycy9z ZXJ2aWNlL2Jhc2ljLXRpbWVvdXQuaHR0cHMuaHRtbCBbIFBhc3MgRmFpbHVyZSBdClwgTm8gbmV3 bGluZSBhdCBlbmQgb2YgZmlsZQpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFj LXdrMi9UZXN0RXhwZWN0YXRpb25zIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0 RXhwZWN0YXRpb25zCmluZGV4IDg4YTIzMGRlM2U0OTBmNTA4OWJmZGQ0YTY5MDllM2I3ODJhYmUx YmQuLjQwZjFlNDRiNTAzZGE3M2Q3MTljYTUwZTdmZGUyMzdhNDEyMzk0ZDMgMTAwNjQ0Ci0tLSBh L0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9ucworKysgYi9MYXlv dXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMKQEAgLTkyNyw0ICs5Mjcs NiBAQCB3ZWJraXQub3JnL2IvMjA1MzAxIFsgTW9qYXZlKyBdIGluc3BlY3Rvci9jYW52YXMvcmVx dWVzdFNoYWRlclNvdXJjZS13ZWJncHUuaHRtbAogCiB3ZWJraXQub3JnL2IvMjA1ODA4IGZhc3Qv dGV4dC9pbnRlcm5hdGlvbmFsL3VuaWNvZGUtYmlkaS1vdGhlci1uZXV0cmFscy5odG1sIFsgUGFz cyBGYWlsdXJlIF0KIAotd2Via2l0Lm9yZy9iLzE5ODk0MiB3ZWJncHUvdmVydGV4LWJ1ZmZlci10 cmlhbmdsZS1zdHJpcC5odG1sIFsgUGFzcyBJbWFnZU9ubHlGYWlsdXJlIF0KXCBObyBuZXdsaW5l IGF0IGVuZCBvZiBmaWxlCit3ZWJraXQub3JnL2IvMTk4OTQyIHdlYmdwdS92ZXJ0ZXgtYnVmZmVy LXRyaWFuZ2xlLXN0cmlwLmh0bWwgWyBQYXNzIEltYWdlT25seUZhaWx1cmUgXQorCit3ZWJraXQu b3JnL2IvMjA2ODY0IGh0dHAvdGVzdHMvd29ya2Vycy9zZXJ2aWNlL2Jhc2ljLXRpbWVvdXQuaHR0 cHMuaHRtbCBbIFBhc3MgRmFpbHVyZSBdClwgTm8gbmV3bGluZSBhdCBlbmQgb2YgZmlsZQo=