[Infra] NVIDIA runtime declarative config for Talos #41

Open
opened 2026-09-11 01:27:35 +00:00 by poimen · 0 comments
Member

Talos Linux prohibits manual driver updates. NVIDIA extensions must be loaded declaratively in machine config. Currently nvidia runtimeClassName used in comfyui + reasoning deployments. Document Talos machine config extension for nvidia-container-runtime. Files: k8s/apps/llm-serving/reasoning.yaml, Talos machine config

Talos Linux prohibits manual driver updates. NVIDIA extensions must be loaded declaratively in machine config. Currently nvidia runtimeClassName used in comfyui + reasoning deployments. Document Talos machine config extension for nvidia-container-runtime. Files: k8s/apps/llm-serving/reasoning.yaml, Talos machine config
poimen added this to the LLM Production Hardening milestone 2026-09-11 01:27:35 +00:00
Sign in to join this conversation.