Files
homelab/k8s/apps
rock f6e569c0e8 fix(llm-serving): clef-flash asks for memory the node can reserve
worker-1 holds 64Gi and the other predictors request about 55Gi, so the 16Gi request
left clef-flash Pending with '0/4 nodes are available: 1 Insufficient memory'. The
weights live on the GPU; host memory covers SGLang's own bookkeeping, so 8Gi is the
honest reservation. The 32Gi limit stays, so a burst still gets the room.
2026-10-27 23:59:28 -07:00
..
2026-10-26 03:32:18 -07:00