Files
homelab/k8s/apps/llm-serving
rock 15a22abb1f fix(llm-serving): clef-flash cannot run on a V100
The CLI path was wrong and is now correct, so the pod reaches the model loader — and
dies there:

  Found GPU0 Tesla V100-PCIE-32GB which is of cuda capability 7.0.
  Your installed torch==2.14.1+cu130 does not include kernels for this GPU.

Every GPU on worker-1 is a V100 (CC 7.0) and the pinned dev-clef image ships kernels for
CC 8.0 and above. Scale to zero so the pod stops crash-looping, and record the reason in
the manifest. Serving a 9.4B backbone on CPU is not a substitute.
2026-10-28 02:41:47 -07:00
..