Bug 252244 – EWS is not adding merging-blocked label on PRs

• Component: Tools / Tests
• Status: RESOLVED FIXED

[Ryan Reno]

My PR https://github.com/WebKit/WebKit/pull/10069 had build failures on Linux and Windows and test failures on all flavors of macOS. I would have expected EWS to put the merging-blocked label on this PR from past experience. This didn't happen.

It's somewhat benign - I wouldn't merge this in this state anyway. I wonder if this is a symptom of another underlying problem in EWS though.

[Radar WebKit Bug Importer]

<rdar://problem/105452651>

[Alexey Proskuryakov]

Aakash can comment more authoritatively, but I've come to expect issues like this to be caused by web hooks not getting served for whatever reason (networking failures, EWS getting overloaded or being restarted).

I wonder if we can make web hook handling more robust in general.

[Aakash Jain]

Just for reference here are few builds which failed (and should have added the merging-blocked label):
https://ews-build.webkit.org/#/builders/73/builds/28498
https://ews-build.webkit.org/#/builders/70/builds/29847
https://ews-build.webkit.org/#/builders/84/builds/6742
https://ews-build.webkit.org/#/builders/8/builds/116784
https://ews-build.webkit.org/#/builders/36/builds/99807

In all of those, the last step "block-pull-request" was skipped, which means that EWS did not attempted to put the label on PR.

It was skipped because EWS thought that the commit was obsolete at that time (because of new push on the PR). Need to check further if that was indeed the case.

[Aakash Jain]

We added some more logging in the UI in https://bugs.webkit.org/show_bug.cgi?id=253451

In https://ews-build.webkit.org/#/builders/12/builds/120226 the logging says: "Skipping this step as hash 16e666579113e2e006564ecd5965fd6a9903b06d is outdated."

However, that's incorrect, the hash is NOT outdated. Even as of right now, that is the latest hash on that PR (https://github.com/WebKit/WebKit/pull/11089).

[Aakash Jain]

The last successful instance of adding merging-blocked label seems to be on Feb 8, 2023 in https://ews-build.webkit.org/#/builders/73/builds/27686 (till feb 8 block-pull-request  step was adding adding merging-blocked label on lot of PRs (~100/day), but after that it abruptly stopped. So seems like something regressed around that time.

There were few changes landed around that time as well. e.g.: this PR modified _is_hash_outdated method which is being used by block-pull-request: https://github.com/WebKit/WebKit/pull/9554/files

[Jonathan Bedard]

Pull request: https://github.com/WebKit/WebKit/pull/11253

[EWS]

Committed 261420@main (a2ee6d8fbe53): <https://commits.webkit.org/261420@main>

Reviewed commits have been landed. Closing PR #11253 and removing active labels.

[Aakash Jain]

buildbot was restarted this morning to pick up this change.

[Aakash Jain]

Seems to be working fine.
e.g.: merging-blocked label was added in https://ews-build.webkit.org/#/builders/82/builds/13840