Commit Graph
2 Commits
Author SHA1 Message Date
Story Crater Bot a005a07648 fix(llm-serving): ornith 504 on cold start
Two bugs. Kong timeouts were on the Ingress; it reads them from the Service, so
its 60s default applied. Moved to the isvc, which KServe propagates.

Probes ran 'ollama list' — models on disk, not in VRAM — so the pod went Ready
before it could serve. Now 'ollama ps', and both models are warmed at startup.
2026-08-15 22:58:24 -07:00
Story Crater Bot e87780b22f feat(llm-serving): adopt InferenceServices into ArgoCD
Five model servers were applied by hand and tracked nowhere. Exported live,
kubectl diff empty on all five, so the first sync adopts without restarting.

prune: false — KServe copies isvc labels to its child Deployment, so ArgoCD
would prune children it does not own and KServe would recreate them.
2026-08-15 22:45:38 -07:00