Results database sometimes returns 400 to ews. e.g.: From https://ews-build.webkit.org/#/builders/73/builds/21649 Checking Results database for failing tests. Identifier: 257475@main, configuration: {'platform': 'mac', 'style': 'release', 'flavor': 'wk1'} imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html: pass_rate: Unknown, pre-existing-failure=False Response from results-db: {} Failed to query results summary with status code 404 It worked fine in previous build https://ews-build.webkit.org/#/builders/73/builds/21648 with Identifier: 257474@main
I'm able to manually reproduce this issue using below commands. It works for 257474@main and 257476@main, but not for 257475@main [bash]$python3 results_db.py imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html --platform mac --flavor wk1 --style release --commit 257474@main imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html pass: 64% [bash]$python3 results_db.py imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html --platform mac --flavor wk1 --style release --commit 257475@main Failed to query results summary with status code 404 imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html No historic data found for query [bash]$python3 results_db.py imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html --platform mac --flavor wk1 --style release --commit 257476@main imported/w3c/web-platform-tests/fullscreen/api/document-exit-fullscreen-nested-shadow-dom.html pass: 63%
Same thing in https://ews-build.webkit.org/#/builders/60/builds/45678/steps/17/logs/results-db (on a branch PR)
<rdar://problem/103416187>