From 9014898fc55e5111cd26dd1e2322eef18e64c027 Mon Sep 17 00:00:00 2001 From: Ruben Hensen Date: Sat, 24 Oct 2026 14:43:38 +0200 Subject: [PATCH] velero: run kopia maintenance daily and throttled Each of the 15 kopia repositories ran maintenance every hour, and about once a day a full run of several minutes that writes its cache to the node's only SSD. Those runs line up with dqlite stalling for seconds and controllers losing their leases (vault 09:57-10:07, argocd and mbgwp 09:17-09:40 today). Make the default frequency 24h and cap the jobs at half a CPU, so a full run writes slower and longer instead of in one burst. --- velero/velero-helm.yaml | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/velero/velero-helm.yaml b/velero/velero-helm.yaml index 89d8aa7..6a19a64 100644 --- a/velero/velero-helm.yaml +++ b/velero/velero-helm.yaml @@ -42,6 +42,22 @@ spec: config: region: minio features: EnableCSI + # Kopia maintenance ran every hour for each of the 15 repositories, + # and once a day as a full run of several minutes that writes its + # cache to the node's only SSD, which stalls dqlite and makes + # controllers lose their leases (docs/upgrade-k8s-1.33.md). Daily + # and throttled instead. Existing BackupRepositories keep their own + # maintenanceFrequency; they were patched to 24h by hand. + defaultRepoMaintainFrequency: 24h + repositoryMaintenanceJob: + repositoryConfigData: + global: + keepLatestMaintenanceJobs: 3 + podResources: + cpuRequest: 100m + cpuLimit: 500m + memoryRequest: 256Mi + memoryLimit: 2Gi credentials: # Use existing secret created by External Secrets Operator # existingSecret: velero-minio-credentials