riotpiao-poimen/homelab
2
0
Fork 0
Code Issues 1 Pull Requests 1 Actions Packages Projects 1 Releases Wiki Activity

feat: add ComfyUI + rebalance GPU allocation #17

Merged
rock merged 1 commits from feat/comfyui-gpu-rebalance into main 2026-09-09 02:11:30 +00:00
Conversation 0 Commits 1 Files Changed 8
+281 -16
rock commented 2026-09-09 01:27:00 +00:00
Owner
Copy Link
Copy Source

GPU Rebalance (4× V100 32GB)

Pod Before After
reasoning (PP=2) 2 GPU 2 GPU
ornith 2 GPU (2 replicas) 1 GPU (1 replica)
comfyui — 1 GPU (new)
qwen-cpu — CPU on cp-2 (new)
embeddings/reranker CPU CPU

Changes

  • ornith.yaml: scale 2→1, remove qwen2.5 co-loading, MAX_LOADED_MODELS=1
  • qwen-cpu.yaml: new Ollama deployment on talos-cp-2 (144GB RAM), 5Gi PVC
  • k8s/apps/comfyui/: new ComfyUI deployment (1 GPU, 50Gi model PVC, ingress)
  • 58-comfyui.yaml: ArgoCD Application (wave 8)

Gateway route update in separate PR (homelab-frontend).

## GPU Rebalance (4× V100 32GB) | Pod | Before | After | |-----|--------|-------| | reasoning (PP=2) | 2 GPU | 2 GPU | | ornith | 2 GPU (2 replicas) | 1 GPU (1 replica) | | comfyui | — | 1 GPU (**new**) | | qwen-cpu | — | CPU on cp-2 (**new**) | | embeddings/reranker | CPU | CPU | ## Changes - `ornith.yaml`: scale 2→1, remove qwen2.5 co-loading, MAX_LOADED_MODELS=1 - `qwen-cpu.yaml`: new Ollama deployment on talos-cp-2 (144GB RAM), 5Gi PVC - `k8s/apps/comfyui/`: new ComfyUI deployment (1 GPU, 50Gi model PVC, ingress) - `58-comfyui.yaml`: ArgoCD Application (wave 8) Gateway route update in separate PR (homelab-frontend).
rock added 1 commit 2026-09-09 01:27:01 +00:00
feat: add ComfyUI, rebalance GPU allocation 39f5fe3683 
GPU rebalance (4× V100 32GB on worker-1):
- reasoning: 2 GPU (unchanged, PP=2 for Qwen3-32B)
- ornith: 2→1 GPU (scale to 1 replica, ornith:35b only)
- comfyui: 0→1 GPU (new)
- embeddings/reranker: 0 GPU (CPU, unchanged)

qwen2.5:3b-instruct moved to CPU on talos-cp-2 (144GB RAM).
Separate Ollama deployment + 5Gi PVC, pulls model on first start.

Gateway config updated in homelab-frontend (separate commit).

Co-authored-by: poimen <[email protected]>
rock merged commit 8790de6038 into main 2026-09-09 02:11:30 +00:00
rock deleted branch feat/comfyui-gpu-rebalance 2026-09-09 02:11:35 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
area/auth
Authentication & authorization
 area/authentik
Authentik OIDC provider config
 area/downstream
Downstream service changes
 area/gateway
API gateway code (homelab-frontend)
 priority/high
Must have
 priority/medium
Should have
 status/blocked
Blocked by dependency
 status/done
Completed
 status/in-progress
Currently being worked on
 status/review
Ready for review
 status/todo
Not started
 type/docs
Documentation
 type/feature
New feature
 type/infra
Infrastructure change
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
poimen rock (Rock)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: riotpiao-poimen/homelab#17