Bug 214921

Summary: Automatically delete old data from ews buildbot instance
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, jbedard, ryanhaddad, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=218817
https://bugs.webkit.org/show_bug.cgi?id=224552
https://bugs.webkit.org/show_bug.cgi?id=270255
Attachments:
Description Flags
Patch
none
Patch none

Description Aakash Jain 2020-07-29 08:30:32 PDT
Automatically delete old data from ews-build. We can choose a time range, maybe 1 year, after which the build logs will be deleted, the build and status-bubble information will still be retained, just the detailed build logs will be deleted. We can use Buildbot's JanitorConfigurator for that (https://docs.buildbot.net/latest/manual/configuration/configurators.html#janitorconfigurator).
Comment 1 Radar WebKit Bug Importer 2020-07-29 08:30:57 PDT
<rdar://problem/66274920>
Comment 2 Aakash Jain 2020-11-23 12:09:51 PST
Created attachment 414810 [details]
Patch
Comment 3 Aakash Jain 2020-11-23 12:15:34 PST
Since currently most of the infrastructure is down and there is almost no load on the server, I took this opportunity to run this on the server as well to delete logs older than 1 year. See: https://ews-build.webkit.org/#/builders/54/builds/1

After deleting the logs, the status-bubbles are still fully functional, buildbot builds are still accessible, just that the individual steps in the buildbot builds wouldn't show the logs, e.g.: https://ews-build.webkit.org/#/builders/19/builds/1
Comment 4 Aakash Jain 2020-11-27 10:36:59 PST
Created attachment 414957 [details]
Patch
Comment 5 Jonathan Bedard 2020-11-30 06:43:40 PST
Comment on attachment 414957 [details]
Patch

I like this change, it seems like a happy medium between outright deleting old builds entirely and keeping them around in some for to run analytics over them.
Comment 6 EWS 2020-11-30 07:05:11 PST
commit-queue failed to commit attachment 414957 [details] to WebKit repository.
Comment 7 EWS 2020-11-30 07:09:01 PST
Committed r270243: <https://trac.webkit.org/changeset/270243>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 414957 [details].