fix(llm-serving): pull clef-candle's mutable tag on every start

:sm70 is rebuilt by CI on every merge to candle-vllm main. The default
IfNotPresent means a node with a cached copy of that tag keeps running the old
binary, so a fix can be merged and deployed and still never reach the pod. The
symptom is a 404 on /v1/systemone while the image tag looks correct.

Always forces the pull.
This commit is contained in:
2026-11-05 10:02:02 +08:00
parent 9617bbe814
commit ea8299c417
+5
View File
@@ -42,6 +42,11 @@ spec:
# and makes every linear-attention layer return zero. The symptom is # and makes every linear-attention layer return zero. The symptom is
# a well-formed /v1/systemone response with wrong answers, not an error. # a well-formed /v1/systemone response with wrong answers, not an error.
image: forgejo.riotpiao.com/riotpiao-poimen/candle-vllm:sm70 image: forgejo.riotpiao.com/riotpiao-poimen/candle-vllm:sm70
# :sm70 is a moving tag. With the default IfNotPresent a rebuilt image
# is never pulled while any node holds a cached copy of that tag, so the
# cluster keeps serving the old binary and the fix looks like it did not
# land. Always forces the pull on every pod start.
imagePullPolicy: Always
command: ["/usr/local/bin/candle-vllm"] command: ["/usr/local/bin/candle-vllm"]
# clef-flash is a hybrid Qwen3_5 model: 8 full-attention layers plus 24 # clef-flash is a hybrid Qwen3_5 model: 8 full-attention layers plus 24
# GDN layers that carry per-sequence recurrent state. It runs on ONE # GDN layers that carry per-sequence recurrent state. It runs on ONE