fix(llm-serving): retire the reference clef-serve, free the GPU

clef-serve (pytorch reference) and clef-candle both claim replicas 1, but only one GPU is free: coder takes 2 of the 4 V100s. They starved each other, so clef-candle sat Pending and the clef-serve Service had no endpoints. The Service now selects app: clef-candle, so the reference receives no traffic even when it runs. Keeping it at 1 only burns a GPU.
2026-11-05 10:28:22 +08:00
1 changed files with 1 additions and 1 deletions
@@ -43,7 +43,7 @@ spec:
  # Cold start is about four minutes: the pod pip-installs on every boot because the
  # torch base image cannot be pushed to the registry (Cloudflare answers 413 above
  # 100 MB per layer). startupProbe allows for that.
-  replicas: 1
+  replicas: 0
  # Recreate, not RollingUpdate. Every GPU card is allocated, so a rolling update leaves
  # the new pod Pending forever waiting for a card the old pod still holds.
  strategy: