Phase 6.6: Add Poimen Memory DLQ queues (ArgoCD managed)
ArgoCD Application: memory-queues ├─ Sync wave: 7 (messaging wave) ├─ Path: k8s/apps/messaging/memory-queues ├─ Namespace: sqs └─ Auto-sync: enabled (prune + selfHeal) Helm Chart: memory-queues ├─ Chart.yaml: v0.1.0 ├─ values.yaml: Queue config └─ templates/queues.yaml: Queue CRD resources Queues Created: 1. poimen-memory-dlq ├─ Purpose: Extraction + webhook + agent failures ├─ Partitions: 3 ├─ Replication factor: 1 ├─ Retention: 14 days (1,209,600 seconds) └─ Visibility timeout: 5 minutes (300 seconds) 2. poimen-memory-metric-dlq ├─ Purpose: Metrics persistence failures ├─ Partitions: 3 ├─ Replication factor: 1 ├─ Retention: 14 days └─ Visibility timeout: 5 minutes Resource: Queue CRD (kmsvc.io/v1alpha1) └─ Managed by: queue-operator (already running in sqs ns) Deployment Flow: ArgoCD (homelab) → sync wave 7 → deploy queues Memory app (poimen) → connects to kmsvc → sends DLQ messages Files: ├─ k8s/apps/messaging/memory-queues/Chart.yaml (new) ├─ k8s/apps/messaging/memory-queues/values.yaml (new) ├─ k8s/apps/messaging/memory-queues/templates/queues.yaml (new) └─ k8s/argocd/apps/50-memory-queues.yaml (new)
This commit is contained in:
@@ -0,0 +1,6 @@
|
||||
apiVersion: v2
|
||||
name: memory-queues
|
||||
description: Kafka queues (DLQ) for Poimen Memory service (Phase 6.6)
|
||||
type: application
|
||||
version: 0.1.0
|
||||
appVersion: "1.0"
|
||||
@@ -0,0 +1,20 @@
|
||||
{{- range .Values.queues }}
|
||||
---
|
||||
apiVersion: kmsvc.io/v1alpha1
|
||||
kind: Queue
|
||||
metadata:
|
||||
name: {{ .name }}
|
||||
namespace: {{ $.Values.namespace }}
|
||||
labels:
|
||||
app: memory-service
|
||||
queue: dlq
|
||||
spec:
|
||||
name: {{ .name }}
|
||||
description: {{ .description }}
|
||||
partitions: {{ .partitions }}
|
||||
replicationFactor: {{ .replicationFactor }}
|
||||
config:
|
||||
retention.ms: "{{ .config.retention.ms }}"
|
||||
message.retention.seconds: "{{ .config.message.retention.seconds }}"
|
||||
visibility.timeout.seconds: "{{ .config.visibility.timeout.seconds }}"
|
||||
{{- end }}
|
||||
@@ -0,0 +1,25 @@
|
||||
# Poimen Memory Service Kafka Queues (kmsvc)
|
||||
# Phase 6.6: DLQ topics for webhook + metrics failures
|
||||
|
||||
queues:
|
||||
# DLQ for extraction, webhook, and agent failures
|
||||
- name: poimen-memory-dlq
|
||||
description: "DLQ for extraction, webhook, and agent failures"
|
||||
partitions: 3
|
||||
replicationFactor: 1
|
||||
config:
|
||||
retention.ms: "1209600000" # 14 days
|
||||
message.retention.seconds: "1209600"
|
||||
visibility.timeout.seconds: "300"
|
||||
|
||||
# DLQ for metrics persistence failures
|
||||
- name: poimen-memory-metric-dlq
|
||||
description: "DLQ for metrics persistence failures"
|
||||
partitions: 3
|
||||
replicationFactor: 1
|
||||
config:
|
||||
retention.ms: "1209600000" # 14 days
|
||||
message.retention.seconds: "1209600"
|
||||
visibility.timeout.seconds: "300"
|
||||
|
||||
namespace: sqs
|
||||
@@ -0,0 +1,20 @@
|
||||
apiVersion: argoproj.io/v1alpha1
|
||||
kind: Application
|
||||
metadata:
|
||||
name: memory-queues
|
||||
namespace: argocd
|
||||
annotations:
|
||||
argocd.argoproj.io/sync-wave: "7"
|
||||
spec:
|
||||
project: homelab
|
||||
source:
|
||||
repoURL: https://forgejo.riotpiao.com/rock/homelab.git
|
||||
targetRevision: main
|
||||
path: k8s/apps/messaging/memory-queues
|
||||
destination:
|
||||
server: https://kubernetes.default.svc
|
||||
namespace: sqs
|
||||
syncPolicy:
|
||||
automated:
|
||||
prune: true
|
||||
selfHeal: true
|
||||
Reference in New Issue
Block a user