Files
homelab/k8s/apps
rock 7bdc8b2de2 fix(llm-serving): set runtimeClassName nvidia on the candle deployment
Without it the container runs under runc, libcuda.so is never injected and
candle-vllm panics in cudarc at startup. The pod reached Running but crashed
on every restart.

Verified live: pod Ready, coder-predictor endpoints populated, /v1/models
reports coder-14b-fp16 and a completion returns OK.
2026-11-05 09:22:48 +08:00
..