feat(llm-serving): serve clef-flash on candle-vllm (#109)

Co-authored-by: rock <[email protected]>
2026-11-05 01:40:42 +00:00
parent 32f1d50e5e
commit 10ce4f8109
3 changed files with 88 additions and 1 deletions
@@ -21,6 +21,10 @@ resources:
  # streams against 71.5 ms and 215 tok/s for the 4-bit MoE. The V100 has FP16
  # tensor cores and no INT4 ones, so 4-bit pays dequantisation on the SM while
  # the memory controller idles at 19%.
+  # clef-candle.yaml serves clef-flash on candle-vllm (hybrid Qwen3_5, one GPU)
+  # and owns the clef-candle label that clef-serve.yaml's Service now selects.
+  # It must not sync against an image built before the GDN conv fix.
+  - clef-candle.yaml
  - coder-14b-fp16.yaml
  - clef-serve.yaml
  # Stable client-facing name for the chat model. poimen-memory points at this Service,