feat(talos): authenticate kube-apiserver against ZITADEL
The apiserver's live OIDC config still pointed at https://authentik.riotpiao.com/application/o/kubernetes/. Authentik now runs zero pods, so that issuer cannot be discovered and every attempt to login with a token instead of a client certificate fails. The template itself carried no OIDC block at all, so a render would have removed the stale config rather than replace it. Add the ZITADEL issuer, the `kubernetes` client id, and the groups/username claims. Three details had to be verified against a real token first: 1. The issuer is https://zitadel.riotpiao.com with no trailing slash and no /application/o/<app>/ suffix. That suffix belonged to the Authentik scheme; the apiserver compares `iss` by exact string equality. 2. ZITADEL does NOT put profile/email claims in the id_token by default, so `oidc-username-claim: email` resolved to nothing. idTokenUserinfoAssertion is now enabled on the `kubernetes` application. 3. ZITADEL asserts roles as a nested urn claim the apiserver cannot read. The `groupsClaim` action (created alongside this change) mirrors the bare role names into a flat `groups` claim. Verified with a full PKCE authorization-code flow against this client: the id_token carries iss=https://zitadel.riotpiao.com, email, preferred_username and groups=[homelab-admins, ...]. With oidc-groups-prefix=oidc: that maps to the existing ClusterRoleBinding homelab-admin-oidc, which grants cluster-admin. The issuer hostname is pinned in extraHostEntries because the apiserver's static pod resolves through the node's DNS, not cluster CoreDNS; the ingress LoadBalancer serves the publicly-trusted Let's Encrypt wildcard certificate. Client-certificate auth is unchanged, so a wrong value degrades OIDC logins without locking anyone out.
This commit is contained in:
@@ -39,6 +39,9 @@ resource "local_file" "controlplane_configs" {
|
||||
dns_servers = var.cluster_config.dns_servers
|
||||
forgejo_registry_ip = var.forgejo_registry_ip
|
||||
forgejo_hostname = var.forgejo_hostname
|
||||
oidc_issuer_hostname = var.oidc_issuer_hostname
|
||||
oidc_issuer_ip = var.oidc_issuer_ip
|
||||
oidc_client_id = var.oidc_client_id
|
||||
zone = each.value.zone
|
||||
allow_scheduling = each.value.allow_scheduling
|
||||
coredns_corefile = file("${path.module}/files/coredns/Corefile")
|
||||
|
||||
@@ -33,6 +33,14 @@ machine:
|
||||
- ip: ${forgejo_registry_ip}
|
||||
aliases:
|
||||
- ${forgejo_hostname}
|
||||
# kube-apiserver's static pod runs on the host network, so it resolves the
|
||||
# OIDC issuer through THIS node's DNS, not cluster CoreDNS. Pin the issuer
|
||||
# to the ingress LoadBalancer so discovery stays on the LAN and presents
|
||||
# the publicly-trusted Let's Encrypt wildcard certificate. Without this
|
||||
# entry the lookup leaves via public DNS and Cloudflare.
|
||||
- ip: ${oidc_issuer_ip}
|
||||
aliases:
|
||||
- ${oidc_issuer_hostname}
|
||||
kubelet:
|
||||
image: ${kubelet_image}
|
||||
defaultRuntimeSeccompProfileEnabled: true
|
||||
@@ -120,10 +128,31 @@ cluster:
|
||||
- ${san}
|
||||
%{ endfor ~}
|
||||
image: ${kube_apiserver_img}
|
||||
# No OIDC block. The cluster authenticates with client certificates. An
|
||||
# earlier Authentik-based kube-apiserver OIDC config was removed from the
|
||||
# live nodes, and leaving it here would re-add an issuer that no longer
|
||||
# resolves on any future machine-config render.
|
||||
# OIDC authentication against ZITADEL. Additive: client-certificate auth
|
||||
# (this session's own admin@homelab-cluster kubeconfig, system:masters)
|
||||
# keeps working unchanged, so a bad value here degrades OIDC logins rather
|
||||
# than locking anyone out.
|
||||
#
|
||||
# The issuer has NO trailing slash and NO /application/o/<app>/ suffix.
|
||||
# That suffix belonged to the Authentik scheme; the apiserver compares `iss`
|
||||
# in the id_token by exact string equality, so the stale value made every
|
||||
# OIDC login fail once Authentik stopped running.
|
||||
#
|
||||
# Groups: ZITADEL asserts roles as a nested urn claim that the apiserver
|
||||
# cannot read. The `groupsClaim` action in ZITADEL mirrors the bare role
|
||||
# names into a flat `groups` claim, which is what oidc-groups-claim consumes.
|
||||
# Verified end to end: a PKCE id_token for this client carries
|
||||
# groups=[homelab-admins, ...], email and preferred_username.
|
||||
#
|
||||
# Prefixes keep OIDC identities from colliding with built-in system:* users
|
||||
# and groups. k8s RBAC bindings therefore target `oidc:homelab-admins`.
|
||||
extraArgs:
|
||||
oidc-issuer-url: https://${oidc_issuer_hostname}
|
||||
oidc-client-id: "${oidc_client_id}"
|
||||
oidc-username-claim: email
|
||||
oidc-groups-claim: groups
|
||||
oidc-username-prefix: "oidc:"
|
||||
oidc-groups-prefix: "oidc:"
|
||||
admissionControl:
|
||||
- name: PodSecurity
|
||||
configuration:
|
||||
|
||||
@@ -198,3 +198,42 @@ variable "forgejo_hostname" {
|
||||
default = "forgejo.riotpiao.com"
|
||||
description = "Forgejo external hostname"
|
||||
}
|
||||
|
||||
# ── kube-apiserver OIDC (ZITADEL) ────────────────────────────────────────────
|
||||
# Authenticates `kubectl` against ZITADEL instead of client certificates only.
|
||||
# Client-certificate auth keeps working in parallel, so a wrong value here
|
||||
# degrades OIDC logins without locking anyone out.
|
||||
#
|
||||
# The issuer is ZITADEL's external host with NO trailing slash and NO
|
||||
# /application/o/<app>/ suffix — a leftover of the Authentik scheme. The
|
||||
# apiserver validates `iss` in the id_token for exact string equality.
|
||||
variable "oidc_issuer_hostname" {
|
||||
type = string
|
||||
default = "zitadel.riotpiao.com"
|
||||
description = "Hostname of the OIDC issuer (ZITADEL). Becomes https://<host> as the issuer."
|
||||
}
|
||||
|
||||
variable "oidc_issuer_ip" {
|
||||
type = string
|
||||
default = "192.168.1.160"
|
||||
description = <<-EOT
|
||||
Address the nodes resolve the OIDC issuer to, via extraHostEntries.
|
||||
|
||||
kube-apiserver's static pod runs on the host network, so it resolves the
|
||||
issuer through the node's own DNS, not cluster CoreDNS. Pointing it at the
|
||||
ingress-nginx LoadBalancer keeps OIDC discovery on the LAN and serves the
|
||||
publicly-trusted Let's Encrypt *.riotpiao.com certificate. Without this the
|
||||
lookup leaves via public DNS and Cloudflare, and discovery either hairpins
|
||||
or fails.
|
||||
EOT
|
||||
}
|
||||
|
||||
variable "oidc_client_id" {
|
||||
type = string
|
||||
default = "396757803089330177"
|
||||
description = <<-EOT
|
||||
ZITADEL client id of the `kubernetes` OIDC application (PKCE, no secret).
|
||||
Must be a STRING: the id is an 18-digit number and an unquoted YAML scalar
|
||||
would be parsed as a float and rejected.
|
||||
EOT
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user