mirror of
https://github.com/rubenhensen/k8scd.git
synced 2026-11-15 14:29:09 +01:00
Ruben Hensen
14e61ee5ee
When a backend closes a kept-alive connection just as Envoy sends a request over it, Envoy returns a 503 (response flag UC) and does not retry by default. ingress-nginx retried these, so the race never showed. The Apache in front of immich (sol-auth) recycles its processes after 30 connections, which made this happen during page loads: three chunks got a 503 and immich failed with "error loading dynamically imported module". authentik and ntfy saw it too, less often. Retry up to twice on connection failures and resets, for every route on the Gateway.
26 lines
747 B
YAML
26 lines
747 B
YAML
# Retry a request when the backend drops a kept-alive connection just as
|
|
# Envoy sends a request over it. Envoy answers that with a 503 (flag UC) and
|
|
# does not retry by default; ingress-nginx did. It happens most behind the
|
|
# Apache of sol-auth (immich), which recycles its processes after 30
|
|
# connections, and broke immich's page loads.
|
|
apiVersion: gateway.envoyproxy.io/v1alpha1
|
|
kind: BackendTrafficPolicy
|
|
metadata:
|
|
name: retry-on-reset
|
|
namespace: envoy-gateway-system
|
|
spec:
|
|
targetRefs:
|
|
- group: gateway.networking.k8s.io
|
|
kind: Gateway
|
|
name: homelab
|
|
retry:
|
|
numRetries: 2
|
|
retryOn:
|
|
triggers:
|
|
- connect-failure
|
|
- reset
|
|
perRetry:
|
|
backOff:
|
|
baseInterval: 25ms
|
|
maxInterval: 250ms
|