Compare commits
1
Commits
main
...
d821718375
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
d821718375 |
@@ -33,7 +33,19 @@ metadata:
|
||||
app: clef-serve
|
||||
app.kubernetes.io/part-of: llm-serving
|
||||
spec:
|
||||
replicas: 1
|
||||
# Parked at 0 to free the only V100 that was not serving anything, so candle-vllm can
|
||||
# run its Phase 0 on one card. All four cards were allocated (coder 2, reasoning 1,
|
||||
# this 1) and a new GPU workload had nowhere to land.
|
||||
#
|
||||
# This is the only GPU consumer in the namespace that is not vLLM, which is why it is
|
||||
# the first card released: the standing instruction is to keep the vLLM pods healthy
|
||||
# until candle-vllm answers, and this pod is not one of them.
|
||||
#
|
||||
# It was serving nothing. The last 30 log lines at park time were 30/30 kubelet
|
||||
# /health probes and no inference request since start (2026-10-30T06:23:40Z). Nothing
|
||||
# in git selects this service. Restore it once the rollout leaves a card free:
|
||||
# 30B-A3B takes 1, Coder-Next TP=2 takes 2, so card 4 is this one.
|
||||
replicas: 0
|
||||
# Recreate, not RollingUpdate. Every GPU card is allocated, so a rolling update leaves
|
||||
# the new pod Pending forever waiting for a card the old pod still holds.
|
||||
strategy:
|
||||
|
||||
Reference in New Issue
Block a user