Ruben Hensen
c8a81e805d
cert-manager: NetworkPolicy
2026-10-26 23:25:28 +01:00
Ruben Hensen
0dc69d34f0
Merge pull request #50 from rubenhensen/proxy-protocol
...
Pass the visitor's address from node001 to the home cluster
2026-10-26 23:12:14 +01:00
Ruben Hensen
30540ea579
node001: send the visitor's address to the home cluster
...
The stream server on 443 now starts each connection with a PROXY header.
nginx sends it to every upstream or none, so Stalwart (8443) and the
local nginx for Gatus and ntfy (8444) get theirs through a hop on
8445/8446 that takes it off again; nothing changes for them.
Deploy after the Gateway accepts the header, or the tunneled hosts stop
answering until it does.
2026-10-26 23:11:38 +01:00
Ruben Hensen
53d74768ad
gateway: take the visitor's address from a PROXY header
...
node001 passes TLS through without opening it, so every request from
the tunneled hosts arrives from 46.224.26.65. Wordfence locked that
address out after 20 failed logins on 2026-10-26, and with it everyone
who logs in to scoutingmbg.nl. With a PROXY header from node001, Envoy
puts the visitor's address in X-Forwarded-For instead.
The header is optional: s2 and ntfy2 point straight at home, and
node001's proxy on port 80 sends none either.
2026-10-26 23:11:38 +01:00
Ruben Hensen
b6462fb3a9
Merge pull request #49 from rubenhensen/roadmap-garage
...
docs: Velero on Garage
2026-10-26 23:04:15 +01:00
Ruben Hensen
bed68c70a8
velero: the switch to Garage was on 10-26
2026-10-26 22:57:35 +01:00
Ruben Hensen
3991a8d726
docs: Velero on Garage, and the off-site copy from the bucket
2026-10-26 22:57:35 +01:00
Ruben Hensen
648f99c505
Merge pull request #35 from rubenhensen/velero-garage
...
Velero backs up to Garage instead of MinIO
2026-10-26 22:52:42 +01:00
Ruben Hensen
20bd3a4bca
Merge pull request #39 from rubenhensen/immich-ml-v2
...
immich: the optimized ML models, cached on a volume
2026-10-25 17:48:40 +01:00
Ruben Hensen
6cba1a9363
immich: the optimized ML models, cached on a volume
2026-10-25 17:46:03 +01:00
Ruben Hensen
acfce6645e
velero: skip PVCs in Longhorn's no-backup group
2026-10-25 17:46:03 +01:00
Ruben Hensen
0de86dd65c
Merge pull request #36 from rubenhensen/renovate-re2
...
Renovate: skip the non-app folders without a lookahead
2026-10-25 17:41:32 +01:00
Ruben Hensen
d7ffdc05f6
docs: Renovate rejected the lookahead ( #32 )
2026-10-25 17:33:39 +01:00
Ruben Hensen
c0f8034e14
renovate: skip the non-app folders through ignorePaths, not a lookahead
2026-10-25 17:33:39 +01:00
Ruben Hensen
a15a4f7c75
Merge pull request #34 from rubenhensen/velero-garage-secret
...
Garage on the NAS, and Velero's key for it
2026-10-25 17:23:33 +01:00
Ruben Hensen
bdafcaf1e0
backup-testing: read Velero's key for Garage
2026-10-25 17:10:32 +01:00
Ruben Hensen
03c3196242
velero: back up to Garage instead of MinIO
2026-10-25 17:10:32 +01:00
Ruben Hensen
b072099cc1
nas: Garage keeps its metadata in SQLite
2026-10-25 17:08:13 +01:00
Ruben Hensen
e10ca337f1
velero: a key for Garage, from Vault
2026-10-25 16:28:43 +01:00
Ruben Hensen
c72b08867f
nas: Garage, which takes over from MinIO
2026-10-25 16:28:43 +01:00
Ruben Hensen
d85362ce3b
docs: the restore test passed against the real backups
2026-10-25 14:57:18 +01:00
Ruben Hensen
018f528fb3
docs: a WordPress cache without plugins
2026-10-25 14:56:10 +01:00
Ruben Hensen
714712b862
docs: WordPress is capped at 12 workers
2026-10-25 13:11:20 +01:00
Ruben Hensen
7dc13466cb
mbgwp: cap Apache at 12 workers so a crawler can't run it out of memory
2026-10-25 13:07:30 +01:00
Ruben Hensen
9b77596bcb
backup-testing: take endpoint, region and bucket from Velero's location
2026-10-25 12:59:25 +01:00
Ruben Hensen
fbf2cb2d92
docs: the unseal key is kept safe
2026-10-25 12:57:18 +01:00
Ruben Hensen
122873ca5c
docs: hensen.io can expire
2026-10-25 12:54:32 +01:00
Ruben Hensen
71449dd185
docs: record the external-secrets upgrade
2026-10-25 12:54:01 +01:00
Ruben Hensen
297d2dffa5
Merge pull request #17 from rubenhensen/renovate/external-secrets-2.x
...
chore(deps): update helm chart external-secrets to v2.14.0
2026-10-25 12:50:28 +01:00
Ruben Hensen
46117ee658
chore(deps): update helm chart external-secrets to v2.14.0
2026-10-25 12:49:06 +01:00
Ruben Hensen
2a5bbc7f44
docs: the scoutingmbg.nl DNS questions are answered
...
Only the four records moved to node001, hensen.io is no longer needed, and SPF's a mechanism doesn't matter since all mail goes through Google.
2026-10-25 12:39:57 +01:00
Ruben Hensen
d7b0372f1a
docs: record the rest of the merged PRs
2026-10-25 12:37:25 +01:00
Ruben Hensen
0ad6ca816c
docs: who cleaned up the snapshots, and the stalls per minute
...
Every minute with dqlite errors in the 23 hours sampled had the SSD fully busy; the controllers with 60s leases held.
2026-10-25 12:35:47 +01:00
Ruben Hensen
3e252799a4
Merge pull request #26 from rubenhensen/renovate/gitea-gitea-28.x
...
chore(deps): update gitea/gitea docker tag to v28
2026-10-25 12:25:03 +01:00
Ruben Hensen
bfd5619e9e
Merge pull request #27 from rubenhensen/renovate/github.com-canonical-go-dqlite-v3-3.x
...
fix(deps): update module github.com/canonical/go-dqlite/v3 to v3.0.4
2026-10-25 12:24:30 +01:00
Ruben Hensen
0b38d8dec8
Merge pull request #33 from rubenhensen/requests
...
Set resource requests from measured usage
2026-10-25 12:23:54 +01:00
Ruben Hensen
083353fb9d
Merge pull request #23 from rubenhensen/renovate/binwiederhier-ntfy-2.x
...
chore(deps): update binwiederhier/ntfy docker tag to v2.34.0
2026-10-25 12:22:45 +01:00
Ruben Hensen
23f9c5c60a
docs: record the merged Renovate PRs
2026-10-25 12:21:38 +01:00
Ruben Hensen
a8bf3d5b64
Merge pull request #31 from rubenhensen/renovate/python-3.x
...
chore(deps): update python docker tag to v3.15.1
2026-10-25 12:17:31 +01:00
Ruben Hensen
618954ae2c
Merge pull request #25 from rubenhensen/renovate/wordpress-0.x
...
chore(deps): update helm chart wordpress to v0.16.7
2026-10-25 12:17:17 +01:00
Ruben Hensen
44dc85d306
Merge pull request #24 from rubenhensen/renovate/https-github.com-kubernetes-csi-external-snapshotter.git-8.x
...
chore(deps): update dependency https://github.com/kubernetes-csi/external-snapshotter.git to v8.7.0
2026-10-25 12:16:25 +01:00
Ruben Hensen
b60735f6b0
Merge pull request #28 from rubenhensen/renovate/cert-manager-1.21.x
...
chore(deps): update helm chart cert-manager to v1.21.3
2026-10-25 12:14:55 +01:00
Ruben Hensen
3a57e5be48
docs: WordPress went out of memory under a crawler
2026-10-25 09:45:33 +01:00
Ruben Hensen
1611f5d1ef
docs: PR 33's window and Renovate's PR limit
2026-10-25 09:44:20 +01:00
Ruben Hensen
5bb1422594
Raise two requests after the morning's numbers
2026-10-25 09:43:11 +01:00
Ruben Hensen
68b692a112
docs: requests are in PR 33
2026-10-25 07:10:37 +01:00
Ruben Hensen
72f49bed51
Set resource requests from measured usage
2026-10-25 07:08:16 +01:00
Ruben Hensen
f4b42757cd
backup-testing: remove k3s's anonymous volumes too
2026-10-25 07:04:17 +01:00
Ruben Hensen
f529bd99ee
docs: triage PR 31
2026-10-25 07:02:07 +01:00
Ruben Hensen
74dec430b8
docs: the restore test is ready to run
2026-10-25 07:01:04 +01:00
Ruben Hensen
6fe0acc061
backup-testing: a restore test from a read-only copy of the bucket
2026-10-25 07:00:49 +01:00
Ruben Hensen
bb34b601d9
docs: the system backups' snapshots hold 258 GiB
2026-10-25 04:35:58 +01:00
Ruben Hensen
e98668d5fa
docs: the cluster check has six parts
2026-10-25 04:35:02 +01:00
Ruben Hensen
389f911823
gatus: also report unhealthy Argo CD apps and CNPG clusters
2026-10-25 04:34:32 +01:00
Ruben Hensen
8f1c6a5b6e
docs: record the repo rules
2026-10-25 04:33:01 +01:00
Ruben Hensen
770631fdc0
ci: check the repo's own manifests for secrets in git and unpinned images
2026-10-25 04:32:13 +01:00
Ruben Hensen
855317b84d
freshrss: pin the alpine/git init container
2026-10-25 04:32:13 +01:00
Ruben Hensen
d69f2638d1
docs: record the vulnerability scan and the old Longhorn instance manager
2026-10-25 04:29:57 +01:00
Ruben Hensen
90e552c9f5
docs: update the roadmap's state
2026-10-25 04:25:43 +01:00
Ruben Hensen
ad14995ba0
docs: record the wider Renovate coverage
2026-10-25 04:25:10 +01:00
Ruben Hensen
c359384ade
renovate: look at every app folder, and at CNPG images
2026-10-25 04:24:56 +01:00
Ruben Hensen
a4fc386ee8
docs: record the new probes
2026-10-25 04:22:28 +01:00
Ruben Hensen
0dc0bc4322
docs: authentik's base URL is already set
2026-10-25 04:22:06 +01:00
Ruben Hensen
d843f31d86
serpbear: add health probes
2026-10-25 04:19:29 +01:00
Ruben Hensen
da23357946
freshrss: add health probes
2026-10-25 04:19:29 +01:00
Ruben Hensen
b9d88f41b9
gitea: add health probes
2026-10-25 04:19:29 +01:00
Ruben Hensen
3c4a8cc8db
docs: bring the authentik README up to date
2026-10-25 04:16:48 +01:00
Ruben Hensen
d17e78130d
docs: record metrics-server and plan the restore test
2026-10-25 04:15:43 +01:00
Ruben Hensen
22c5a325d6
Add metrics-server
2026-10-25 04:11:59 +01:00
Ruben Hensen
ef07307f93
renovate: keep CI's Helm at Argo CD's version
2026-10-25 04:10:30 +01:00
Ruben Hensen
aa940134ea
docs: record the CI and the Renovate triage
2026-10-25 04:10:14 +01:00
Ruben Hensen
f86ed09cd8
renovate: drop the github-tags manager, which duplicated the argocd one
2026-10-25 04:09:52 +01:00
Ruben Hensen
6d2bc379ba
ci: retry when a registry rate-limits
2026-10-25 04:06:53 +01:00
Ruben Hensen
67c21c30d8
Render and validate every app on PRs and pushes
2026-10-25 03:57:24 +01:00
Ruben Hensen
0c52d8a467
apps: list external-snapshotter's automated sync once
2026-10-25 03:57:24 +01:00
Ruben Hensen
f2e4c5aff6
docs: record the backup check
2026-10-25 03:49:43 +01:00
Ruben Hensen
d836e4608c
gatus: check backups and Vault's seal from inside the cluster
2026-10-25 03:48:05 +01:00
Ruben Hensen
1f56e67e8b
docs: what the disk did in the last day, and foto's DNS
2026-10-25 03:42:13 +01:00
Ruben Hensen
cadac4cebf
docs: record the cleanup and what is left of it
2026-10-25 03:29:55 +01:00
Ruben Hensen
bc71061db7
Remove commented-out files, the empty secrets app and a stale script copy
2026-10-25 03:27:32 +01:00
Ruben Hensen
7d3a64e5c8
docs: record the NetworkPolicies for the other apps and Vault
2026-10-25 03:24:07 +01:00
Ruben Hensen
e137e79b75
vault: only ESO, Envoy and the node reach Vault
2026-10-25 03:21:53 +01:00
Ruben Hensen
67dc4f0783
Limit the other public apps to their own pods, DNS and the internet
2026-10-25 03:21:53 +01:00
Ruben Hensen
684f536f2f
docs: record the NetworkPolicies for immich, mbgwp and authentik
2026-10-25 03:17:11 +01:00
Ruben Hensen
1439466af4
authentik: limit the pods to each other, DNS and the internet
2026-10-25 03:15:20 +01:00
Ruben Hensen
57514c3c14
immich: limit the pods to each other, DNS and the internet
2026-10-25 03:12:02 +01:00
Ruben Hensen
57851bf43a
mbgwp: limit WordPress to its database, DNS and the internet
2026-10-25 03:09:06 +01:00
Ruben Hensen
ada909ee02
docs: plan off-site backups through a friend's bucket
2026-10-25 03:05:39 +01:00
Ruben Hensen
345de16552
docs: record the Vault 2.2.1 upgrade
2026-10-25 02:52:52 +01:00
Ruben Hensen
7396cc3ed6
vault: fix the listing-visibility flag in the OIDC job
2026-10-25 02:52:02 +01:00
Ruben Hensen
26ca83457c
vault: upgrade to 2.2.1, with a script to roll the pods
2026-10-25 02:40:45 +01:00
Ruben Hensen
4709194483
docs: tick off the authentik login test
2026-10-25 02:40:45 +01:00
Ruben Hensen
ad2d6fbae5
docs: record the authentik 2026.8 upgrade
2026-10-25 02:34:51 +01:00
Ruben Hensen
077711472e
authentik: upgrade to 2026.8.5
2026-10-25 02:31:00 +01:00
Ruben Hensen
43f741141d
authentik: upgrade to 2026.5.6
2026-10-25 02:23:15 +01:00
Ruben Hensen
cbee4955d3
authentik: drop the redis values, which the chart no longer has
2026-10-25 02:23:15 +01:00
Ruben Hensen
a70dff6fdd
docs: add a roadmap in place of the wishlist
2026-10-25 02:16:31 +01:00
Ruben Hensen
ab0a09a356
docs: the immich login moved to auth.scoutingmbg.nl
2026-10-25 02:08:59 +01:00
Ruben Hensen
b2649a682c
immich: log in through auth.scoutingmbg.nl
...
The Scouts Online connection now redirects to auth.scoutingmbg.nl, the
group's own domain for the authentik login, so immich's OAuth issuer
moves there too.
2026-10-25 02:03:50 +01:00
Ruben Hensen
ce3846bcd3
node001: tunnel scoutingmbg.nl and www to the home cluster
...
The group's DNS moved scoutingmbg.nl (A to node001) and www (CNAME to
rubenhensen.nl) here as well, so the WordPress site got node001's mail
certificate. Pass them through to the home cluster like foto and auth.
2026-10-25 02:59:00 +02:00