fix(llm-serving): call the sglang CLI by its full path
The container args began with a bare 'serve'. This image installs its CLI at /opt/sglang/bin/sglang and puts nothing called serve on PATH, so every start ended with 'exec: serve: not found' — 19 restarts, and the InferenceService never became ready. Name the binary, then the subcommand.
This commit is contained in:
@@ -53,6 +53,10 @@ spec:
|
||||
# layers use linear attention and hold a fixed 48 MiB state regardless
|
||||
# of length. Memory is therefore dominated by the BF16 weights (18.8 GB),
|
||||
# not the cache, which is why one V100-32GB is enough.
|
||||
# The image ships its CLI at /opt/sglang/bin/sglang and puts no `serve` on
|
||||
# PATH, so a bare `serve` failed with "exec: serve: not found" on every start
|
||||
# (19 restarts). Name the binary by its full path.
|
||||
- /opt/sglang/bin/sglang
|
||||
- serve
|
||||
- --model-path=Cloudflare/clef-flash
|
||||
- --host=0.0.0.0
|
||||
|
||||
Reference in New Issue
Block a user