riotpiao-poimen/homelab
2
0
Fork 0
Code Issues 24 Pull Requests Actions Packages Projects 1 Releases Wiki Activity

k8s(llm-serving): stop managing the coder InferenceService #106

Merged
rock merged 1 commits from retire-coder-isvc into main 2026-11-03 22:07:58 +00:00
Conversation 0 Commits 1 Files Changed 1
-5
rock commented 2026-11-03 22:07:32 +00:00
Owner
Copy Link
Copy Source

coder.yaml requests 2 V100s and never reaches Ready, permanently occupying half the GPU pool. candle-vllm serves the coder model on the other two cards. ArgoCD has prune:false, so this removes management only; the live object is deleted manually after sync.

coder.yaml requests 2 V100s and never reaches Ready, permanently occupying half the GPU pool. candle-vllm serves the coder model on the other two cards. ArgoCD has prune:false, so this removes management only; the live object is deleted manually after sync.
rock added 1 commit 2026-11-03 22:07:33 +00:00
k8s(llm-serving): stop managing the coder InferenceService 6d02f59a9b 
coder.yaml requests 2 V100s and never reaches Ready, so it permanently
occupies half the GPU pool. candle-vllm serves the coder model on the
other two cards; the unmanaged predictor starves clef-serve and blocks
its own rollout on every sync.

ArgoCD has prune:false, so this removes management only. The live object
is deleted manually after the sync, otherwise selfHeal recreates it.
rock merged commit c5099e3a8f into main 2026-11-03 22:07:58 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
area/auth
Authentication & authorization
 area/authentik
Authentik OIDC provider config
 area/downstream
Downstream service changes
 area/event-bus
Event routing and notification pipeline
 area/gateway
API gateway code (homelab-frontend)
 area/notifications
Gotify, SMTP, push notifications
 area/observer
Poimen goal-driven observation and pattern detection
 priority/high
Must have
 priority/medium
Should have
 status/blocked
Blocked by dependency
 status/done
Completed
 status/in-progress
Currently being worked on
 status/review
Ready for review
 status/todo
Not started
 type/docs
Documentation
 type/feature
New feature
 type/infra
Infrastructure change
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
poimen rock (Rock)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: riotpiao-poimen/homelab#106