mirror of
https://gitlab.kube.huskypup.net/Scooby/Homelabv4.git
synced 2026-08-21 05:26:49 +00:00
Root cause (confirmed via ztunnel logs): the argo-cd chart's default
NetworkPolicies only allow each component's application port (e.g. 6379
for redis), but Istio ambient mode routes ALL pod-to-pod traffic through
ztunnel's HBONE tunnel on port 15008 first - so the tunnel itself was
being blocked even though the "real" port was allowed. Every inter-pod
connection in the argocd namespace hung for exactly 10s then reset;
ztunnel's own log named it directly ("connection timed out, maybe a
NetworkPolicy is blocking HBONE port 15008"). This broke argocd-server's
Redis-backed session/cluster-info caching cluster-wide and was silently
preventing the root Application from picking up new child Applications.
Fix: additive NetworkPolicy allowing ingress on 15008 for all argocd
pods (NetworkPolicies union across multiple policies selecting a pod,
so this doesn't touch/replace the chart's rendered ones - safe across
Helm upgrades).
Also: dropped argocd from the namespace-enrollment job's waypoint list.
argocd's only AuthorizationPolicy (allow-argocd-access) is a plain
source-namespace/IP match with no L7 rules - its own status shows
"attached to ztunnel", not waypoint - so forcing L7 waypoint processing
onto the namespace was unnecessary overhead, not a security requirement.
ztunnel's mTLS still fully covers it. (This was a red herring for the
HBONE bug itself, not the fix, but a valid simplification found along
the way.)
33 lines
1.2 KiB
YAML
33 lines
1.2 KiB
YAML
---
|
|
# Istio ambient mesh routes ALL pod-to-pod traffic through ztunnel's HBONE
|
|
# tunnel on port 15008, not the application's own port - the app-port-only
|
|
# NetworkPolicies the argo-cd chart renders by default (e.g. argocd-redis
|
|
# only allowing port 6379) block the actual HBONE connection even though the
|
|
# "real" port is allowed, because ztunnel's encrypted tunnel itself never
|
|
# gets past the policy. Symptom: every inter-pod connection in the argocd
|
|
# namespace hangs for exactly 10s then resets - ztunnel logs the reason
|
|
# directly: "connection timed out, maybe a NetworkPolicy is blocking HBONE
|
|
# port 15008". Confirmed 2026-08-17: this was breaking argocd-server's
|
|
# Redis-backed session/cluster-info caching cluster-wide.
|
|
#
|
|
# NetworkPolicies are additive (union of all policies selecting a pod), so
|
|
# this supplements the chart's rendered policies rather than replacing them -
|
|
# safe across Helm upgrades.
|
|
apiVersion: networking.k8s.io/v1
|
|
kind: NetworkPolicy
|
|
metadata:
|
|
name: argocd-allow-hbone
|
|
namespace: argocd
|
|
spec:
|
|
podSelector:
|
|
matchLabels:
|
|
app.kubernetes.io/instance: argocd
|
|
policyTypes:
|
|
- Ingress
|
|
ingress:
|
|
- from:
|
|
- namespaceSelector: {}
|
|
ports:
|
|
- protocol: TCP
|
|
port: 15008
|