riotpiao-poimen/homelab-frontend
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: route qwen2.5:3b-instruct to CPU service #20

Merged
rock merged 1 commits from feat/qwen-cpu-route into main 2026-09-09 02:11:02 +00:00
Conversation 0 Commits 1 Files Changed 2
+2 -2
rock commented 2026-09-09 01:27:05 +00:00
Owner
Copy Link
Copy Source

Route qwen2.5:3b-instruct to qwen-cpu.llm-serving:80 (CPU on cp-2) instead of ornith-predictor (GPU on worker-1).

Companion to homelab GPU rebalance PR.

Route `qwen2.5:3b-instruct` to `qwen-cpu.llm-serving:80` (CPU on cp-2) instead of `ornith-predictor` (GPU on worker-1). Companion to homelab GPU rebalance PR.
rock added 1 commit 2026-09-09 01:27:07 +00:00
feat: route qwen2.5:3b-instruct to CPU service on cp-2
CI / CI (pull_request) Successful in 3m12s
Details
d40a0946e1 
Model moved from ornith-predictor GPU to dedicated qwen-cpu
Deployment on talos-cp-2 (CPU). Frees 1 GPU for ComfyUI.

Co-authored-by: poimen <[email protected]>
rock merged commit c56406d4a2 into main 2026-09-09 02:11:02 +00:00
rock deleted branch feat/qwen-cpu-route 2026-09-09 02:11:06 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
area/auth
Authentication & authorization
 area/authentik
Authentik OIDC provider config
 area/downstream
Downstream service changes
 area/gateway
API gateway code
 priority/high
Must have
 priority/low
Nice to have
 priority/medium
Should have
 status/blocked
Blocked by dependency
 status/done
Completed
 status/in-progress
Currently being worked on
 status/review
Ready for review
 status/todo
Not started
 type/docs
Documentation
 type/feature
New feature
 type/infra
Infrastructure change
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
poimen rock (Rock)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: riotpiao-poimen/homelab-frontend#20