fix(llm-serving): call the sglang CLI by its full path

The container args began with a bare 'serve'. This image installs its CLI at
/opt/sglang/bin/sglang and puts nothing called serve on PATH, so every start ended
with 'exec: serve: not found' — 19 restarts, and the InferenceService never became
ready. Name the binary, then the subcommand.
This commit is contained in:
2026-10-28 02:34:42 -07:00
parent 13343976e4
commit 569eb84737
+4
View File
@@ -53,6 +53,10 @@ spec:
# layers use linear attention and hold a fixed 48 MiB state regardless
# of length. Memory is therefore dominated by the BF16 weights (18.8 GB),
# not the cache, which is why one V100-32GB is enough.
# The image ships its CLI at /opt/sglang/bin/sglang and puts no `serve` on
# PATH, so a bare `serve` failed with "exec: serve: not found" on every start
# (19 restarts). Name the binary by its full path.
- /opt/sglang/bin/sglang
- serve
- --model-path=Cloudflare/clef-flash
- --host=0.0.0.0