Files
homelab/k8s
rock 4a49a84fb0 fix(llm-serving): retire the reference clef-serve, free the GPU
clef-serve (pytorch reference) and clef-candle both claim replicas 1, but only
one GPU is free: coder takes 2 of the 4 V100s. They starved each other, so
clef-candle sat Pending and the clef-serve Service had no endpoints.

The Service now selects app: clef-candle, so the reference receives no traffic
even when it runs. Keeping it at 1 only burns a GPU.
2026-11-05 10:28:22 +08:00
..