From 569eb84737940f10f2dbebb64e5dbc451b8d62bd Mon Sep 17 00:00:00 2001 From: rock Date: Wed, 28 Oct 2026 02:34:42 -0700 Subject: [PATCH] fix(llm-serving): call the sglang CLI by its full path MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The container args began with a bare 'serve'. This image installs its CLI at /opt/sglang/bin/sglang and puts nothing called serve on PATH, so every start ended with 'exec: serve: not found' — 19 restarts, and the InferenceService never became ready. Name the binary, then the subcommand. --- k8s/apps/llm-serving/clef-flash.yaml | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/k8s/apps/llm-serving/clef-flash.yaml b/k8s/apps/llm-serving/clef-flash.yaml index c2749bf..8a71e23 100644 --- a/k8s/apps/llm-serving/clef-flash.yaml +++ b/k8s/apps/llm-serving/clef-flash.yaml @@ -53,6 +53,10 @@ spec: # layers use linear attention and hold a fixed 48 MiB state regardless # of length. Memory is therefore dominated by the BF16 weights (18.8 GB), # not the cache, which is why one V100-32GB is enough. + # The image ships its CLI at /opt/sglang/bin/sglang and puts no `serve` on + # PATH, so a bare `serve` failed with "exec: serve: not found" on every start + # (19 restarts). Name the binary by its full path. + - /opt/sglang/bin/sglang - serve - --model-path=Cloudflare/clef-flash - --host=0.0.0.0