Compare commits

...
36 Commits
Author SHA1 Message Date
renovate[bot] e8145e12d7 chore(deps): update helm chart velero to v12.2.3 2026-11-03 21:12:41 +00:00
Ruben Hensen 3d1b7dd230 Merge pull request #70 from rubenhensen/home-ip-62.41.86.53
Home IP is now 62.41.86.53
2026-11-03 22:11:32 +01:00
Ruben Hensen aaae182844 Home IP is now 62.41.86.53
After the ISP cut the connection, it came back on a new address. node001
still tunneled everything to 62.41.86.27, so every host behind it timed
out. Moves the tunnel, the ldap, s2 and ntfy2 records and the Gatus DNS
plan to the new address.
2026-11-03 22:09:55 +01:00
renovate[bot] e0e64e1097 chore(deps): update python docker tag to v3.15.2 (#68)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2026-11-02 19:52:53 +00:00
Ruben Hensen 7db73a100e Merge pull request #63 from rubenhensen/renovate/twinproduction-gatus-5.x
chore(deps): update twinproduction/gatus docker tag to v5.38.0
2026-10-29 10:55:26 +01:00
Ruben Hensen 40cd825602 Merge pull request #62 from rubenhensen/roadmap-2026-10-28
docs: the roadmap as of 2026-10-28
2026-10-29 10:55:23 +01:00
renovate[bot] bbb56e0e25 chore(deps): update twinproduction/gatus docker tag to v5.38.0 2026-10-28 22:57:23 +00:00
Ruben Hensen a4b09fc51e docs: the roadmap as of 2026-10-28 2026-10-28 16:01:16 +01:00
Ruben Hensen 0589bb3e08 Merge pull request #61 from rubenhensen/immich-pg14-cleanup
immich: remove the PostgreSQL 14 cluster
2026-10-28 15:44:45 +01:00
Ruben Hensen c298ad8746 immich: remove the PostgreSQL 14 cluster 2026-10-28 15:40:14 +01:00
Ruben Hensen fe105a4fa7 Merge pull request #60 from rubenhensen/mariadb-11.4
MariaDB: newest 11.4 patch, and keep Renovate on 11.4
2026-10-28 15:36:16 +01:00
Ruben Hensen 1afd4b6bbd mariadb: newest 11.4 patch, and keep Renovate on 11.4 2026-10-28 15:31:40 +01:00
Ruben Hensen b4663216db Merge pull request #59 from rubenhensen/immich-share-people
immich: share the group account's people with everyone
2026-10-28 15:17:06 +01:00
Ruben Hensen 955c22c665 Merge pull request #58 from rubenhensen/memory-limits
Memory limits from a day of measurements
2026-10-28 15:16:55 +01:00
Ruben Hensen f7396b3cb7 immich: share the group account's people with everyone 2026-10-28 15:10:06 +01:00
Ruben Hensen 1f894996e6 docs: memory limits on the roadmap 2026-10-28 14:58:03 +01:00
Ruben Hensen c380bfc0cf Memory limits from a day of measurements 2026-10-28 14:57:34 +01:00
Ruben Hensen c3597ef0a6 Merge pull request #45 from rubenhensen/renovate/mariadb-operator-26.x
chore(deps): update helm chart mariadb-operator to v26
2026-10-27 10:43:09 +01:00
Ruben Hensen baa8c70b55 Merge pull request #46 from rubenhensen/renovate/mariadb-operator-crds-26.x
chore(deps): update helm chart mariadb-operator-crds to v26
2026-10-27 10:38:31 +01:00
Ruben Hensen 1efa6c2b93 Merge pull request #40 from rubenhensen/renovate/ghcr.io-cloudnative-pg-postgresql-17.x
chore(deps): update ghcr.io/cloudnative-pg/postgresql docker tag to v17.11
2026-10-27 09:51:44 +01:00
Ruben Hensen 15a92294a6 Merge pull request #41 from rubenhensen/renovate/actualbudget-1.x
chore(deps): update helm chart actualbudget to v1.9.5
2026-10-27 09:31:49 +01:00
Ruben Hensen 144b9dda2b Merge pull request #48 from rubenhensen/renovate/docker.io-envoyproxy-gateway-helm-1.x
chore(deps): update docker.io/envoyproxy/gateway-helm docker tag to v1.9.3
2026-10-27 09:31:28 +01:00
Ruben Hensen 920e54b43c Merge pull request #44 from rubenhensen/renovate/ubuntu-26.x
chore(deps): update dependency ubuntu to v26
2026-10-27 09:31:03 +01:00
Ruben Hensen 665147a691 Merge pull request #43 from rubenhensen/renovate/python-3.x
chore(deps): update python docker tag to v3.15
2026-10-27 09:30:50 +01:00
renovate[bot] 1ba1d5f1a0 chore(deps): update ghcr.io/cloudnative-pg/postgresql docker tag to v17.11 2026-10-27 08:30:49 +00:00
Ruben Hensen 285a64f980 Merge pull request #38 from rubenhensen/renovate/alpine-git-2.x
chore(deps): update alpine/git docker tag to v2.54.0
2026-10-27 09:30:32 +01:00
Ruben Hensen 6cf41b0f14 Merge pull request #37 from rubenhensen/renovate/freshrss-freshrss-1.x
chore(deps): update freshrss/freshrss docker tag to v1.30.4
2026-10-27 09:30:16 +01:00
renovate[bot] 5678adfa82 chore(deps): update freshrss/freshrss docker tag to v1.30.4 2026-10-26 23:02:19 +00:00
Ruben Hensen 2e2d367f63 Merge pull request #57 from rubenhensen/roadmap-cnpg
docs: CNPG backups and the infra NetworkPolicies are in
2026-10-27 00:00:51 +01:00
renovate[bot] a36fc6f348 chore(deps): update python docker tag to v3.15 2026-10-26 22:28:58 +00:00
renovate[bot] f6186d5a11 chore(deps): update helm chart mariadb-operator-crds to v26 2026-10-26 21:54:29 +00:00
renovate[bot] 2ccaea24a8 chore(deps): update helm chart mariadb-operator to v26 2026-10-26 21:54:25 +00:00
renovate[bot] a2abb66fea chore(deps): update dependency ubuntu to v26 2026-10-26 21:54:19 +00:00
renovate[bot] b721c80599 chore(deps): update helm chart actualbudget to v1.9.5 2026-10-26 21:54:08 +00:00
renovate[bot] 09026a5ff0 chore(deps): update alpine/git docker tag to v2.54.0 2026-10-26 21:54:03 +00:00
renovate[bot] 1fcfd3ad61 chore(deps): update docker.io/envoyproxy/gateway-helm docker tag to v1.9.3 2026-10-26 21:53:47 +00:00
34 changed files with 238 additions and 90 deletions

No files matched your search

+1 -1
View File
@@ -18,7 +18,7 @@ concurrency:
jobs:
validate:
runs-on: ubuntu-24.04
runs-on: ubuntu-26.04
timeout-minutes: 20
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
+1 -1
View File
@@ -12,7 +12,7 @@ spec:
project: default
source:
repoURL: https://community-charts.github.io/helm-charts
targetRevision: 1.8.9
targetRevision: 1.9.5
chart: actualbudget
helm:
values: |
+4
View File
@@ -103,6 +103,8 @@ spec:
requests:
cpu: 70m
memory: 560Mi
limits:
memory: 1536Mi
volumes:
- name: patched-ca-bundle
configMap:
@@ -192,6 +194,8 @@ spec:
requests:
cpu: 100m
memory: 336Mi
limits:
memory: 1Gi
volumes:
- name: patched-ca-bundle
configMap:
+6
View File
@@ -38,16 +38,22 @@ spec:
requests:
cpu: 10m
memory: 48Mi
limits:
memory: 128Mi
cainjector:
resources:
requests:
cpu: 10m
memory: 80Mi
limits:
memory: 256Mi
webhook:
resources:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
syncPolicy:
syncOptions:
- CreateNamespace=true
+2
View File
@@ -28,6 +28,8 @@ spec:
requests:
cpu: 10m
memory: 48Mi
limits:
memory: 128Mi
destination:
server: https://kubernetes.default.svc
namespace: cnpg-system
+1 -1
View File
@@ -12,7 +12,7 @@ spec:
repoURL: docker.io/envoyproxy
chart: gateway-helm
# v1.9 supports Kubernetes 1.33 to 1.36
targetRevision: v1.9.2
targetRevision: 1.9.3
helm:
values: |
config:
@@ -24,16 +24,22 @@ spec:
requests:
cpu: 20m
memory: 64Mi
limits:
memory: 128Mi
certController:
resources:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 128Mi
webhook:
resources:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
destination:
server: https://kubernetes.default.svc
namespace: external-secrets
@@ -21,6 +21,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 128Mi
destination:
server: https://kubernetes.default.svc
namespace: cnpg-system
+16 -2
View File
@@ -1,6 +1,6 @@
# Requests from what the components used on 2026-10-25 (kubectl top every
# 5 minutes; highest value plus 10%). No limits until there are daytime
# numbers, see docs/roadmap.md.
# 5 minutes; highest value plus 10%). Memory limits at about twice the
# highest value seen then or on 2026-10-27, rounded up; no CPU limits.
apiVersion: apps/v1
kind: StatefulSet
metadata:
@@ -14,6 +14,8 @@ spec:
requests:
cpu: 150m
memory: 704Mi
limits:
memory: 2560Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -28,6 +30,8 @@ spec:
requests:
cpu: 100m
memory: 128Mi
limits:
memory: 512Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -42,6 +46,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 256Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -56,6 +62,8 @@ spec:
requests:
cpu: 20m
memory: 96Mi
limits:
memory: 256Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -70,6 +78,8 @@ spec:
requests:
cpu: 10m
memory: 48Mi
limits:
memory: 128Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -84,6 +94,8 @@ spec:
requests:
cpu: 10m
memory: 48Mi
limits:
memory: 128Mi
---
apiVersion: apps/v1
kind: Deployment
@@ -98,3 +110,5 @@ spec:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
+2
View File
@@ -67,6 +67,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 512Mi
env:
# Newer boto3 adds checksums that S3-compatible stores can reject;
# the plugin's docs suggest sending them only when required.
+3 -1
View File
@@ -6,7 +6,7 @@ spec:
instances: 1
# Pinned so a new operator default (PostgreSQL 18 since CNPG 1.26.3) can't
# start an in-place major upgrade. CNPG filled this in at creation.
imageName: ghcr.io/cloudnative-pg/postgresql:17.4
imageName: ghcr.io/cloudnative-pg/postgresql:17.11
primaryUpdateStrategy: unsupervised
# WAL archiving and base backups to Garage, see postgresql-backup.yaml
plugins:
@@ -18,6 +18,8 @@ spec:
requests:
cpu: 50m
memory: 256Mi
limits:
memory: 1Gi
bootstrap:
initdb:
database: authentik
+1 -1
View File
@@ -13,7 +13,7 @@ spec:
restartPolicy: Never
containers:
- name: sync
image: python:3.12-alpine
image: python:3.15-alpine
command:
- sh
- -c
+3 -3
View File
@@ -18,7 +18,7 @@ records:
- name: "ldap"
expire: 300
type: A
content: "62.41.86.27"
content: "62.41.86.53"
- name: "argocd"
expire: 300
type: A
@@ -60,7 +60,7 @@ records:
- name: "s2"
expire: 300
type: A
content: "62.41.86.27"
content: "62.41.86.53"
# ntfy for Gatus alerts, one next to each Gatus. Same reasoning as s2.
- name: "ntfy1"
expire: 300
@@ -69,7 +69,7 @@ records:
- name: "ntfy2"
expire: 300
type: A
content: "62.41.86.27"
content: "62.41.86.53"
- name: "@"
expire: 300
type: MX
+7 -2
View File
@@ -27,7 +27,9 @@ view, and everything is shared with everyone automatically.
- **immich has no user groups**; albums are shared per user, as viewer or
editor. The owner and editors of an album may add users and change
their roles. Search only covers your own photos and those of partners
you show in your timeline.
you show in your timeline. People (face recognition) are per user too,
and a partner's library doesn't bring its people along; since 3.3 a
user can share people with the users in their cluster group.
## Design
@@ -46,7 +48,10 @@ view, and everything is shared with everyone automatically.
every user into every album of the group account (`fotoupload@`), as
editor or viewer by quota; the group account's library as a partner of
everyone, shown in the timeline; album invitations for albums older than
a week hidden; sessions of OAuth users older than 30 days ended. Albums
a week hidden; sessions of OAuth users older than 30 days ended;
everyone in the group account's cluster group with its people shared
(names editable by those who may upload, added 2026-10-28, when nobody
but the group account could search by face). Albums
that kaderleden create get the group account as editor first (in the
database, since the API only lets an album's owner or editors share
it), so they go to everyone too; names starting with "Privé"/"Prive"
+62 -29
View File
@@ -1,22 +1,27 @@
# Roadmap
Where the cluster stands and what is left, as of 2026-10-25. Takes over
Where the cluster stands and what is left, as of 2026-10-28. Takes over
from wishlist.txt (January 2026, removed); its items are sorted in at the
bottom.
## State
One node: opti1, an OptiPlex 5060 with an i5-8600T, 32 GB and one 1 TB
SATA SSD that is 72% full. microk8s v1.36.5 from 1.36/edge, snap held.
35 Argo CD apps (with metrics-server), all Synced/Healthy; every Longhorn
volume has one replica. authentik 2026.8.5, Vault 2.2.1. Backups go to the
NAS (192.168.1.99): Longhorn to NFS at 00:00 (7 kept), Velero to Garage
(MinIO until 2026-10-26) at 01:00 (daily kept 30 days, weekly 90 days).
SATA SSD that is 54% full. microk8s v1.36.5 from 1.36/edge, snap held.
39 Argo CD apps (with metrics-server), all Synced/Healthy; every Longhorn
volume has one replica. authentik 2026.8.5, Vault 2.2.1, immich 3.3.5 on
PostgreSQL 17, MariaDB 11.4.13. Memory requests and limits on everything
but Longhorn, the Vault servers, calico and the LDAP outpost. Backups go
to the NAS (192.168.1.99): Longhorn to NFS at 00:00 (7 kept), Velero to
Garage (MinIO until 2026-10-26) at 01:00 (daily kept 30 days, weekly 90
days), and CNPG to Garage (a base backup at 03:00, the WAL every 5
minutes, 30 days).
Gatus on s1 (node001, Hetzner) and s2 (home) watch each other and alert
through ntfy; s2 also gets an hourly report from inside the cluster on the
backups, Vault's seal, the Argo CD apps and the CNPG clusters.
Every app namespace has NetworkPolicies, and CI renders and validates all
apps on every PR. node001 runs mail and tunnels the public hosts home.
Every namespace with pods but kube-system has NetworkPolicies, and CI
renders and validates all apps on every PR. node001 runs mail and tunnels
the public hosts home.
## Follow-ups from this week
@@ -26,14 +31,22 @@ docs/longhorn-second-ssd.md:
- [x] Read `~/iosample.log` on opti1: the worst stretch was not the
backups but 8.5 hours of Longhorn merging immich-claim's deleted
snapshots (2026-10-24 14:30-23:15), see docs/upgrade-k8s-1.33.md
- [ ] From 2026-10-27, if immich runs without problems: delete
`immich/postgresql-cluster.yaml` (the PG14 cluster still runs, 20 GiB),
the Longhorn snapshots and backups `immich-pg14-pre-vchord` and
`immich-pg17-pre-v3`, and both dumps in `~` on opti1. PostgreSQL 14
reaches end of life on 2026-11-12
- [x] From 2026-10-27, if immich runs without problems: delete
`immich/postgresql-cluster.yaml` (the PG14 cluster, 20 GiB), the
Longhorn snapshots and backups `immich-pg14-pre-vchord` and
`immich-pg17-pre-v3`, and both dumps in `~` on opti1. Done 2026-10-28
(PR #61), with the PG14 volume's other Longhorn backups.
`immich-pg17-pre-v3` only ever was a snapshot
- [ ] The upgrade's dqlite and backend copies in `/root/` on opti1
(`backend-*.tar`, `dqlite-pre-*`)
- [ ] Log in to immich as a jeugdlid (quota 0)
- [ ] Log in to immich as a jeugdlid (quota 0): no uploads, albums as
viewer, people searchable but not renamable
- [x] Searching by face: people are per user in immich, and a partner's
library doesn't bring its people along, so since the personal accounts
only the group account could. share-sync now puts everyone in the
group account's cluster group and shares its people (immich 3.3's
person sharing; PR #59, 2026-10-28): 4430 people, 169 named, for each
of the 6 accounts, with write access for those who may upload
- [ ] Back to 1.36/stable once it is at v1.36.5 or later (still v1.36.2 on
2026-10-25). The snap is held, so microk8s gets no updates at all until
someone refreshes it
@@ -215,7 +228,8 @@ Findings from 2026-10-25:
22:48, since the old pod waited for its connections to close. The first
base backups: 46 MB in 29 s and 776 MB in 3.5 minutes. immich's
`immediate` backup ran before the plugin was up and failed; a manual one
(`immich-postgres-17-first`) went through
(`immich-postgres-17-first`) went through. The 03:00 base backups of
10-27 and 10-28 completed for both; the failed backup is deleted
- [ ] Restore one of them into a new Cluster (`bootstrap.recovery` from
the ObjectStore, to a point in time) to see that it works. After that,
decide whether Velero still needs to copy the CNPG data directories
@@ -241,11 +255,13 @@ Findings from 2026-10-25:
MinIO still has the kopia repositories of namespaces that are gone
(~156 GB: nextcloud, ttrss, whisper-priv, whisper-webui, blog, ghost,
mbg-wordpress, sogo, sogo-mail, outrun-game, owntracks); decide first
whether any of them is worth keeping
whether any of them is worth keeping. The dailies of 10-27 and 10-28
on Garage completed without errors
- [ ] Garage's SQLite WAL (`meta/db.sqlite-wal`) was 1.7 GB on
2026-10-26 next to a 270 MB database, and going by the folders in
`meta/snapshots`, each 6-hourly metadata snapshot takes about 70
minutes. Not growing; check again after a week of normal use
minutes. Not growing; check again after a week of normal use. 1.8 GB
on 2026-10-28
### 6. Monitoring
@@ -314,13 +330,14 @@ Counted 2026-10-25 over the 73 running containers:
OIDC logins of Vault and FreshRSS reach authentik, all 24
ExternalSecrets refresh, raft intact; Gitea no longer reaches the NAS
or Vault, and a pod in `default` no longer reaches Vault or Gitea
- [ ] Certificates couldn't renew in those 11 namespaces: Envoy may only
- [x] Certificates couldn't renew in those 11 namespaces: Envoy may only
reach each app's own port, and cert-manager's HTTP-01 solver listens on
8089. ynab's renewal hung from 2026-10-26 17:35 UTC; a policy for the
solver pods, applied by hand in actual-budget that evening, let it
through within 20 seconds (now valid until 2027-01-24). PR #51 adds it
to all 11. Without it the next renewals hang too: gitea on 11-15,
bolletjestrui on 11-18, the rest from 12-03
to all 11 (merged 2026-10-26 22:27 UTC). Without it the next renewals
would hang too; the first real test is gitea's on 11-15, then
bolletjestrui on 11-18 and the rest from 12-03
- [x] The infrastructure namespaces (cert-manager, cnpg-system,
external-secrets, envoy-gateway-system, velero, mariadb-system, dns,
default), merged 2026-10-26: PR #54 for envoy-gateway-system (22:31
@@ -341,8 +358,19 @@ Counted 2026-10-25 over the 73 running containers:
requested. Still without requests: Longhorn (22 containers, its chart),
the Vault servers, the LDAP outpost, immich's PG14 cluster and three in
kube-system
- [ ] Memory limits, once there are daytime numbers: the night ones miss
immich's machine learning at work (it idles at 234Mi)
- [x] Memory limits: PR #58, for everything that got requests in #33.
About twice the highest memory from `kubectl top` every 5 minutes from
2026-10-26 22:29 to 2026-10-27 21:55 UTC or the night of #33, rounded
up; no CPU limits. No OOM kills that day. immich's machine learning
sat idle all day (240Mi), so on 2026-10-28 a test image went through
CLIP, face recognition and OCR inside the container: 884Mi with all
three loaded, limit 2Gi
- [ ] authentik's server fails its liveness probe while its database is
away (`/-/health/live/` answers 500 when PostgreSQL is down), so each
database restart gets the server killed too, as on 2026-10-27 for
PostgreSQL 17.11. The login only comes back once the server has
started again. A liveness probe that doesn't touch the database would
leave it at not ready
- [x] WordPress (scoutingmbg.nl) was OOMKilled at 08:27:59 UTC on
2026-10-25, its third restart: a crawler asked for 88 pages and assets
within a few seconds (normally ~6 a minute), Apache started a PHP worker
@@ -408,10 +436,15 @@ every PR.
fail the run; tested with a planted Secret and an untagged image), plus
PR annotations for containers without requests or probes. freshrss's
`alpine/git` init container had no tag; now `v2.52.0`
- [ ] Automerge patch versions of low-risk apps now that CI runs: PR #52
(ntfy, gatus, freshrss, serpbear, actual-budget and CI's own tools;
three days after the release, only on weekday evenings and at the
weekend, when the cluster can be reached)
- [x] Automerge patch versions of low-risk apps now that CI runs: PR #52,
merged 2026-10-26 (ntfy, gatus, freshrss, serpbear, actual-budget and
CI's own tools; three days after the release, only on weekday evenings
and at the weekend, when the cluster can be reached). Nothing has
merged itself yet by 2026-10-28
- [x] MariaDB stays on 11.4 (PR #60, 2026-10-28): Renovate offered 11.8.9
as a minor update (#42, closed), but 11.8 can't be rolled back and has
community support until June 2028, against May 2029 for 11.4. Renovate
now only offers 11.4 patches; the next LTS step, 12.3, is by hand
- [x] Renovate listed external-snapshotter twice (#15 and #24): its
`argocd` manager and a custom `github-tags` regex both matched. The
regex is gone; Renovate should close #15 by itself
@@ -503,8 +536,8 @@ critical / high:
| Image | Crit | High | What to do |
|---|---|---|---|
| tensorchord/cloudnative-pgvecto.rs:14-v0.2.1 | 38 | 342 | immich's old PG14 cluster; goes with the cleanup from 2026-10-27 |
| cloudnative-pg/postgresql:17.4 | 27 | 260 | authentik's database, a Debian 11 image. Renovate now offers 17.7; a `17.x-standard-trixie` image is more current |
| tensorchord/cloudnative-pgvecto.rs:14-v0.2.1 | 38 | 342 | immich's old PG14 cluster; deleted 2026-10-28 |
| cloudnative-pg/postgresql:17.4 | 27 | 260 | authentik's database, a Debian 11 image. 17.11 since PR #40 (2026-10-27); not scanned again, a `17.x-standard-trixie` image is more current |
| tensorchord/cloudnative-vectorchord:17.11-1.1.1 | 17 | 136 | immich's database; look for a newer tag |
| longhornio/longhorn-instance-manager:v1.7.3 | 11 | 159 | still serves 16 volumes, see below |
| actualbudget/actual-server:26.6.0 | 8 | 83 | chart 1.8.9; Renovate now covers it |
@@ -514,7 +547,7 @@ critical / high:
| rubenhensen/bolletjestrui:main-10268f1 | 5 | 76 | rebuild on a current base image |
| coredns/coredns:1.10.1 | 5 | 70 | see below |
| dexidp/dex:v2.45.1, argocd v3.5.6, redis 8.2.3 | 4, 1, 2 | | come with Argo CD |
| mariadb:11.4.5 | 4 | 65 | the newest 11.4 patch; Renovate now covers it |
| mariadb:11.4.5 | 4 | 65 | 11.4.13 since PR #60; Renovate stays on 11.4 (it offered 11.8, PR #42) |
| calico v3.29.3 | 2-3 | ~50 | comes with microk8s |
| goauthentik ldap / server 2026.8.5 | 3, 1 | 74, 65 | the next authentik patch |
+4 -3
View File
@@ -169,8 +169,9 @@ pgvecto.rs. Done 2026-10-24, about an hour of immich downtime:
v2.4.1 refused to start (it only accepts VectorChord <0.6); v2.5.0 and up
accept <2, so immich went to v2.7.5, the last 2.x. It rebuilt both
indexes as `vchordrq` in about 1.5 minutes
- [ ] After a few days without problems: delete the old cluster
- [x] After a few days without problems: delete the old cluster
(`immich/postgresql-cluster.yaml`), the snapshot/backup and the dump.
Done 2026-10-28 (PR #61), with the PG14 volume's Longhorn backups.
Rolling back means reverting the old volume to the snapshot, since its
embeddings are now `real[]` without pgvecto.rs
- [x] immich 3.x: v2.7.5 → v3.3.5 with chart 0.10.3 → 0.13.4 on
@@ -189,8 +190,8 @@ pgvecto.rs. Done 2026-10-24, about an hour of immich downtime:
(v3.3.0), for faster ML with less memory; numerically the same models,
so no jobs to rerun. The model cache is an emptyDir, so the one-off
preparation repeats on every restart
- [ ] After a few days without problems: delete the `immich-pg17-pre-v3`
snapshot and dump together with the PG14 leftovers above
- [x] After a few days without problems: delete the `immich-pg17-pre-v3`
snapshot and dump together with the PG14 leftovers above (2026-10-28)
## k8s-dqlite write stalls (found 2026-10-22)
+4 -2
View File
@@ -23,7 +23,7 @@ spec:
io.kompose.service: freshrss
spec:
initContainers:
- image: alpine/git:v2.52.0
- image: alpine/git:v2.54.0
name: git
command:
- git
@@ -74,7 +74,7 @@ spec:
value: Europe/Amsterdam
# 1.30.3 ships PHP 8.4.27, which fixes CVE-2026-109618 and
# CVE-2026-109619.
image: freshrss/freshrss:1.30.3
image: freshrss/freshrss:1.30.4
name: freshrss
ports:
- containerPort: 80
@@ -83,6 +83,8 @@ spec:
requests:
cpu: 50m
memory: 176Mi
limits:
memory: 512Mi
# TCP, because mod_auth_openidc answers 401 to anything that isn't a
# browser.
readinessProbe:
+2 -2
View File
@@ -62,7 +62,7 @@ node, both PowerDNS Authoritative. PowerDNS LUA records health-check
addresses and only return the healthy ones:
```
@ 30 IN LUA A "ifurlup('https://status.rubenhensen.nl/health', {{'46.224.26.65'}, {'62.41.86.27'}})"
@ 30 IN LUA A "ifurlup('https://status.rubenhensen.nl/health', {{'46.224.26.65'}, {'62.41.86.53'}})"
```
The double braces make two groups. PowerDNS returns the first group that has
@@ -85,7 +85,7 @@ Steps:
1. Parent zone (`dns/domains/rubenhensen.nl.yaml`, synced to TransIP): add
`status NS ns-hetzner.rubenhensen.nl.` and `status NS ns-home.rubenhensen.nl.`,
plus A records for `ns-hetzner` (46.224.26.65) and `ns-home` (62.41.86.27).
plus A records for `ns-hetzner` (46.224.26.65) and `ns-home` (62.41.86.53).
First check that TransIP accepts NS records for a subdomain.
2. Hetzner: run PowerDNS from node001.nix with `enable-lua-records=yes` and
the bind backend. Use the same zone file as home. Open 53/udp and 53/tcp.
+1 -1
View File
@@ -256,7 +256,7 @@ spec:
type: RuntimeDefault
containers:
- name: check
image: python:3.15.1-alpine3.24
image: python:3.15.2-alpine3.24
command: ["python", "/script/check.py"]
env:
- name: PYTHONDONTWRITEBYTECODE
+1 -1
View File
@@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: gatus
image: twinproduction/gatus:v5.37.0
image: twinproduction/gatus:v5.38.0
env:
- name: GATUS_CONFIG_PATH
value: /config/config.yaml
+2
View File
@@ -54,6 +54,8 @@ spec:
requests:
cpu: 20m
memory: 336Mi
limits:
memory: 1Gi
# /api/healthz checks the database and the cache.
readinessProbe:
httpGet:
+8 -2
View File
@@ -67,6 +67,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 256Mi
image:
repository: docker.io/valkey/valkey
tag: 9.1.2-alpine@sha256:48332870af354a799964c0012ae1194a0bf2bf894eb508f945810596dc2d8d11
@@ -93,6 +95,8 @@ spec:
requests:
cpu: 100m
memory: 1280Mi
limits:
memory: 3Gi
# Node trusts its built-in roots, which still include the
# ones above the compromised eMudhra intermediates. Use
# patched-ca-bundle through OpenSSL until Node ships a fix.
@@ -117,12 +121,14 @@ spec:
image:
repository: ghcr.io/immich-app/immich-machine-learning
pullPolicy: IfNotPresent
# Idle at night (234Mi); the models take over a GiB when
# it works.
# Idle at 240Mi; 884Mi with CLIP, face recognition and
# OCR loaded (2026-10-28, a test image through each).
resources:
requests:
cpu: 50m
memory: 1Gi
limits:
memory: 2Gi
env:
TRANSFORMERS_CACHE: /cache
HF_XET_CACHE: /cache/huggingface-xet
+2
View File
@@ -71,6 +71,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 512Mi
env:
# Newer boto3 adds checksums that S3-compatible stores can reject;
# the plugin's docs suggest sending them only when required.
+6 -1
View File
@@ -13,6 +13,8 @@ spec:
requests:
cpu: 20m
memory: 320Mi
limits:
memory: 1Gi
postgresql:
shared_preload_libraries:
@@ -27,7 +29,10 @@ spec:
# Filled once from the PostgreSQL 14 cluster (immich-postgres) after its
# embedding columns were turned into real[] and pgvecto.rs was dropped,
# see docs/upgrade-k8s-1.33.md.
# see docs/upgrade-k8s-1.33.md. That cluster is gone since 2026-10-28, so
# creating this Cluster again fails here, on purpose: an empty database
# would start immich with an empty library. Restore from Garage instead
# (bootstrap.recovery, see postgresql-backup.yaml).
bootstrap:
initdb:
database: immich
-28
View File
@@ -1,28 +0,0 @@
apiVersion: postgresql.cnpg.io/v1
kind: Cluster
metadata:
name: immich-postgres
namespace: immich
spec:
instances: 1
# Use TensorChord's CNPG-compatible image with pgvecto.rs v0.2.1
imageName: ghcr.io/tensorchord/cloudnative-pgvecto.rs:14-v0.2.1
postgresql:
shared_preload_libraries:
- "vectors.so"
bootstrap:
initdb:
database: immich
owner: immich
postInitSQL:
- CREATE EXTENSION IF NOT EXISTS vectors;
- CREATE EXTENSION IF NOT EXISTS cube;
- CREATE EXTENSION IF NOT EXISTS earthdistance CASCADE;
- ALTER USER immich WITH SUPERUSER;
storage:
size: 20Gi
storageClass: longhorn
+66 -2
View File
@@ -8,6 +8,10 @@
# - the group account's library is shared as a partner and shown in
# everyone's timeline, so search covers it (immich only searches your own
# and your timeline partners' photos);
# - everyone is put in the group account's cluster group and gets its
# people (person sharing, immich 3.3): people are per user, and a partner
# library doesn't bring its people along. Those who may upload can name
# them, for everyone;
# - the invitation notifications for albums older than a week are hidden,
# or a new member would get one per album;
# - sessions of OAuth users older than SESSION_MAX_AGE_DAYS are ended, so
@@ -15,8 +19,11 @@
# Online.
# Albums and partners go through the API. Joining other people's albums
# (the API only lets an album's owner or editors share it), the timeline
# flag (which only the receiving user can set), the notifications and the
# sessions go straight to the database.
# flag and the cluster group (which only the receiving user can set or
# accept), sharing the people (the API wants person.update, which the
# group's key lacks, and with password login off nobody can log in as the
# group to add it), the notifications and the sessions go straight to the
# database.
apiVersion: v1
kind: ConfigMap
metadata:
@@ -24,6 +31,7 @@ metadata:
namespace: immich
data:
sync.py: |
import collections
import json
import os
import subprocess
@@ -129,6 +137,62 @@ data:
'UPDATE partner SET "inTimeline" = true WHERE "sharedById" = :\'group\' AND NOT "inTimeline"',
group=group_id,
)
# What accepting an invitation to the group account's cluster group does
# (ClusterGroupService.acceptRequest): the person groups only the member
# has people in move along. Members with people in groups that others
# also have people in are left alone; that only happens after sharing.
for (email,) in sql(
"""
BEGIN;
CREATE TEMP TABLE moving ON COMMIT DROP AS
SELECT u.id FROM "user" u, "user" g
WHERE g.id = :'group' AND u.id = ANY (:'members'::uuid[])
AND u."clusterGroupId" <> g."clusterGroupId"
AND NOT EXISTS (
SELECT 1 FROM person p
JOIN person o ON o."personGroupId" = p."personGroupId" AND o."ownerId" <> p."ownerId"
WHERE p."ownerId" = u.id
);
UPDATE person_group SET "clusterGroupId" = (SELECT "clusterGroupId" FROM "user" WHERE id = :'group')
WHERE id IN (SELECT p."personGroupId" FROM person p JOIN moving m ON m.id = p."ownerId");
DELETE FROM cluster_group_request
WHERE "userId" IN (SELECT id FROM moving)
AND "clusterGroupId" = (SELECT "clusterGroupId" FROM "user" WHERE id = :'group');
UPDATE "user" SET "clusterGroupId" = (SELECT "clusterGroupId" FROM "user" WHERE id = :'group')
WHERE id IN (SELECT id FROM moving)
RETURNING email;
COMMIT;
""",
group=group_id,
members="{" + ",".join(members) + "}",
):
print(f"put {email} in the group's cluster group", flush=True)
# What PUT /people/users does for the group account: its people, with
# their names, in every member's people list and search filters. Write
# access (naming people, for everyone) for those who may upload.
shared = sql(
"""
INSERT INTO person_user ("personGroupId", "sharedById", "sharedWithId", role)
SELECT p."personGroupId", p."ownerId", m.id, m.role::person_user_role_enum
FROM person p
JOIN "user" g ON g.id = p."ownerId"
CROSS JOIN unnest(:'ids'::uuid[], :'roles'::text[]) AS m(id, role)
JOIN "user" u ON u.id = m.id AND u."clusterGroupId" = g."clusterGroupId"
WHERE p."ownerId" = :'group' AND NOT p."isHidden"
AND NOT EXISTS (
SELECT 1 FROM person_user pu
WHERE pu."personGroupId" = p."personGroupId" AND pu."sharedById" = p."ownerId"
AND pu."sharedWithId" = m.id AND pu.role = m.role::person_user_role_enum
)
ON CONFLICT ("personGroupId", "sharedById", "sharedWithId") DO UPDATE SET role = EXCLUDED.role
RETURNING "sharedWithId", role
""",
group=group_id,
ids="{" + ",".join(wanted) + "}",
roles="{" + ",".join("read" if role == "viewer" else "write" for role in wanted.values()) + "}",
)
for (uid, role), count in sorted(collections.Counter(map(tuple, shared)).items()):
print(f"share {count} people with {members[uid]} ({role})", flush=True)
sql(
"""
UPDATE notification SET "deletedAt" = now()
+1 -1
View File
@@ -13,7 +13,7 @@ spec:
source:
chart: mariadb-operator-crds
repoURL: https://mariadb-operator.github.io/mariadb-operator
targetRevision: 25.10.4
targetRevision: 26.10.2
syncPolicy:
automated:
prune: true
+7 -1
View File
@@ -13,13 +13,15 @@ spec:
source:
chart: mariadb-operator
repoURL: https://mariadb-operator.github.io/mariadb-operator
targetRevision: 25.10.4
targetRevision: 26.10.2
helm:
values: |
resources:
requests:
cpu: 10m
memory: 48Mi
limits:
memory: 128Mi
metrics:
enabled: true
serviceMonitor:
@@ -29,6 +31,8 @@ spec:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
serviceMonitor:
enabled: false
certController:
@@ -36,6 +40,8 @@ spec:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
serviceMonitor:
enabled: false
syncPolicy:
+1 -1
View File
@@ -8,7 +8,7 @@ spec:
name: mbgwp-mariadb-credentials
key: root-password
image: mariadb:11.4.5
image: mariadb:11.4.13
imagePullPolicy: IfNotPresent
port: 3306
+1 -1
View File
@@ -2,7 +2,7 @@
let
# Public IP of the home network where the k8s cluster ingress lives.
# Keep in sync with dns/domains/rubenhensen.nl.yaml.
homeIP = "62.41.86.27";
homeIP = "62.41.86.53";
# Hosts tunneled to the home k8s cluster. Each entry gets:
# * an SNI map entry for TCP passthrough on :443
+8 -2
View File
@@ -82,14 +82,20 @@
"description": "A PostgreSQL major upgrade needs pg_upgrade or a dump, not a tag bump",
"matchDepNames": [
"ghcr.io/cloudnative-pg/postgresql",
"ghcr.io/tensorchord/cloudnative-vectorchord",
"ghcr.io/tensorchord/cloudnative-pgvecto.rs"
"ghcr.io/tensorchord/cloudnative-vectorchord"
],
"matchUpdateTypes": [
"major"
],
"enabled": false
},
{
"description": "MariaDB goes from one LTS to the next by hand, after a dump: there is no way back. 11.4 has community support until May 2029, longer than 11.8 (June 2028); the next step is 12.3 (June 2029). Within 11.4 the patches come through",
"matchDepNames": [
"mariadb"
],
"allowedVersions": "<11.5"
},
{
"description": "Patch updates of apps that hold little state and are easy to roll back, and of CI's tools, merge themselves once CI passes: three days after the release, in the evening or at the weekend, when the cluster can be reached. Not the databases, operators, Vault, authentik, Longhorn, Velero, immich, Gitea or WordPress. Renovate merges itself; the repo has no branch protection for GitHub's auto-merge to wait on",
"matchFileNames": [
+2
View File
@@ -60,6 +60,8 @@ spec:
requests:
cpu: 10m
memory: 160Mi
limits:
memory: 512Mi
readinessProbe:
httpGet:
path: /login
+2
View File
@@ -7,6 +7,8 @@ injector:
requests:
cpu: 10m
memory: 32Mi
limits:
memory: 128Mi
# The chart's default anti-affinity forbids two injector pods on one
# node, so on this single node a rolling update can never start the new
# pod while the old one runs. Recreate removes the old pod first, which
+3 -1
View File
@@ -8,7 +8,7 @@ spec:
source:
chart: velero
repoURL: https://vmware-tanzu.github.io/helm-charts
targetRevision: 12.2.1
targetRevision: 12.2.3
helm:
values: |
# Velero builds its repository maintenance jobs from a Deployment
@@ -71,6 +71,8 @@ spec:
requests:
cpu: 10m
memory: 64Mi
limits:
memory: 128Mi
# 512Mi got the server OOMKilled 314 times, including halfway
# through a backup of ~14.7k items.
resources: