feat(llm-serving): scale ornith to 2 replicas instead of a dedicated grm GPU

reasoning keeps its 2 GPUs untouched. verifier's freed GPU goes to a second ornith replica instead of a standalone qwen-only pod -- both replicas load ornith:35b + qwen2.5:3b-instruct, k8s Service load-balances across them, so 2 concurrent implementer-style calls get independent instances.
2026-08-18 18:25:12 -07:00
parent 50d00ae350
commit 5d7b9acd43
4 changed files with 24 additions and 114 deletions
@@ -11,7 +11,6 @@ kind: Kustomization
 # in tens of seconds, not a rolling update.
 resources:
  - embeddings.yaml
-  - grm.yaml
  - ornith.yaml
  - reasoning.yaml
  - reranker.yaml