config: env-based service URIs via ConfigMap (prod: SOPS-encrypted)
CI / CI (pull_request) Successful in 32m52s
CI / CI (pull_request) Successful in 32m52s
- config.yaml: prod config with cluster-internal DNS (LLM, OpenSearch, Authentik, Temporal, API-GW) - config.local.yaml: dev config with external URLs via ingress - deployment.yaml: remove hardcoded URIs, read all from ConfigMap envFrom - All downstream service URIs now configurable per environment - Production config encrypted with SOPS (Age-based) - Application code reads LLM_ENDPOINT, OPENSEARCH_HOST, AUTHENTIK_ISSUER, etc. from ENV - Simplifies prod/dev switching: just swap ConfigMap, no code changes
This commit is contained in:
@@ -0,0 +1,157 @@
|
|||||||
|
# Poimen Memory - Environment Configuration Guide
|
||||||
|
|
||||||
|
All downstream service URIs are read from environment variables, sourced from ConfigMap.
|
||||||
|
|
||||||
|
## How It Works
|
||||||
|
|
||||||
|
1. **ConfigMap provides URIs**: `k8s/app/config.yaml` (production, SOPS-encrypted)
|
||||||
|
2. **Deployment injects via envFrom**: `envFrom: configMapRef: poimen-memory-config`
|
||||||
|
3. **Application reads from ENV**: Code parses `LLM_ENDPOINT`, `OPENSEARCH_HOST`, `AUTHENTIK_ISSUER`, etc.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
# deployment.yaml
|
||||||
|
envFrom:
|
||||||
|
- configMapRef:
|
||||||
|
name: poimen-memory-config # All vars injected as ENV
|
||||||
|
```
|
||||||
|
|
||||||
|
## Environment Variables
|
||||||
|
|
||||||
|
### LLM Service (Entity & Fact Extraction)
|
||||||
|
- `LLM_ENDPOINT` — full URL to chat/completions endpoint
|
||||||
|
- `LLM_API_BASE` — base API URL (used for client initialization)
|
||||||
|
- `LLM_MODEL` — model identifier (ornith:35b, qwen:7b, etc.)
|
||||||
|
- `LLM_TIMEOUT_SECS` — timeout for LLM requests
|
||||||
|
- `ENABLE_LLM_EXTRACTION` — enable/disable LLM extraction (true/false)
|
||||||
|
|
||||||
|
### OpenSearch (Vector Store, BM25)
|
||||||
|
- `OPENSEARCH_HOST` — hostname:port
|
||||||
|
- `OPENSEARCH_SCHEME` — http or https
|
||||||
|
- `OPENSEARCH_VERIFY_CERTS` — SSL certificate verification (true/false)
|
||||||
|
|
||||||
|
### Authentik (OIDC)
|
||||||
|
- `AUTHENTIK_ISSUER` — OIDC issuer URL
|
||||||
|
- `AUTHENTIK_VERIFY_SSL` — SSL certificate verification (true/false)
|
||||||
|
- `MEM_AUTH_MODE` — auth mode: jwt | apikey | none
|
||||||
|
|
||||||
|
### Temporal (Workflow Orchestration - Future)
|
||||||
|
- `TEMPORAL_ENDPOINT` — temporal frontend hostname:port
|
||||||
|
- `TEMPORAL_NAMESPACE` — temporal namespace
|
||||||
|
|
||||||
|
### API Gateway (Route Optimization - Future)
|
||||||
|
- `GATEWAY_URL` — gateway base URL
|
||||||
|
|
||||||
|
### Memory Service Config
|
||||||
|
- `MEM_AUTH_MODE` — jwt | apikey | none
|
||||||
|
- `MEM_RATE_LIMIT_INGEST` — ingest requests per second
|
||||||
|
- `MEM_RATE_LIMIT_QUERY` — query requests per second
|
||||||
|
- `MEM_EMBEDDING_BATCH_SIZE` — batch size for embeddings
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Deployment Scenarios
|
||||||
|
|
||||||
|
### Production (SOPS-Encrypted ConfigMap)
|
||||||
|
|
||||||
|
**File**: `k8s/app/config.yaml`
|
||||||
|
|
||||||
|
Services use cluster-internal DNS:
|
||||||
|
```yaml
|
||||||
|
LLM_ENDPOINT: http://reasoning-predictor.llm-serving.svc.cluster.local:8000/v1/chat/completions
|
||||||
|
OPENSEARCH_HOST: opensearch.poimen.svc.cluster.local:9200
|
||||||
|
AUTHENTIK_ISSUER: https://authentik.auth.svc.cluster.local:9443/application/o/poimen/
|
||||||
|
TEMPORAL_ENDPOINT: temporal-frontend.temporal.svc.cluster.local:7233
|
||||||
|
GATEWAY_URL: http://api-gw.poimen.svc.cluster.local:8080
|
||||||
|
MEM_AUTH_MODE: jwt
|
||||||
|
```
|
||||||
|
|
||||||
|
**Deploy**:
|
||||||
|
```bash
|
||||||
|
# SOPS auto-decrypts based on .sops.yaml age key
|
||||||
|
kubectl apply -f k8s/app/config.yaml -k k8s/app/
|
||||||
|
```
|
||||||
|
|
||||||
|
### Local/Development (Plaintext ConfigMap)
|
||||||
|
|
||||||
|
**File**: `k8s/app/config.local.yaml`
|
||||||
|
|
||||||
|
Services via external URLs (ingress):
|
||||||
|
```yaml
|
||||||
|
LLM_ENDPOINT: https://api.riotpiao.com/v1/chat/completions
|
||||||
|
OPENSEARCH_HOST: opensearch.riotpiao.com:443
|
||||||
|
AUTHENTIK_ISSUER: https://authentik.riotpiao.com/application/o/poimen/
|
||||||
|
TEMPORAL_ENDPOINT: temporal.riotpiao.com:443
|
||||||
|
GATEWAY_URL: https://api.riotpiao.com
|
||||||
|
MEM_AUTH_MODE: none
|
||||||
|
```
|
||||||
|
|
||||||
|
**Deploy** (override production config):
|
||||||
|
```bash
|
||||||
|
# Delete prod config, apply local
|
||||||
|
kubectl delete configmap poimen-memory-config -n poimen
|
||||||
|
kubectl apply -f k8s/app/config.local.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Encrypting with SOPS
|
||||||
|
|
||||||
|
Production `config.yaml` is encrypted with SOPS (Age-based).
|
||||||
|
|
||||||
|
**Encrypt**:
|
||||||
|
```bash
|
||||||
|
sops -e k8s/app/config.yaml > k8s/app/config.yaml.enc
|
||||||
|
mv k8s/app/config.yaml.enc k8s/app/config.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
**Decrypt for editing** (SOPS auto-handles with $EDITOR):
|
||||||
|
```bash
|
||||||
|
sops k8s/app/config.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
**View decrypted** (without editing):
|
||||||
|
```bash
|
||||||
|
sops -d k8s/app/config.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
**.sops.yaml** defines encryption key:
|
||||||
|
```yaml
|
||||||
|
creation_rules:
|
||||||
|
- path_regex: k8s/app/config.yaml
|
||||||
|
key_groups:
|
||||||
|
- age:
|
||||||
|
- <age-public-key>
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Application Code Pattern
|
||||||
|
|
||||||
|
Example: Application should read URIs from ENV at startup.
|
||||||
|
|
||||||
|
```rust
|
||||||
|
// Pseudocode
|
||||||
|
let llm_endpoint = env::var("LLM_ENDPOINT")
|
||||||
|
.unwrap_or("http://localhost:11434/v1/chat/completions".to_string());
|
||||||
|
let opensearch_host = env::var("OPENSEARCH_HOST")
|
||||||
|
.unwrap_or("localhost:9200".to_string());
|
||||||
|
let auth_mode = env::var("MEM_AUTH_MODE")
|
||||||
|
.unwrap_or("none".to_string());
|
||||||
|
|
||||||
|
// Initialize clients with these URIs
|
||||||
|
let llm_client = LlmClient::new(llm_endpoint)?;
|
||||||
|
let search_client = OpenSearchClient::new(opensearch_host)?;
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Summary
|
||||||
|
|
||||||
|
| Aspect | Production | Local |
|
||||||
|
|--------|-----------|-------|
|
||||||
|
| **Config File** | `config.yaml` | `config.local.yaml` |
|
||||||
|
| **Encryption** | SOPS (Age) | Plaintext |
|
||||||
|
| **Service URIs** | Cluster-internal DNS | External HTTPS |
|
||||||
|
| **Auth Mode** | JWT (Authentik) | None (disabled) |
|
||||||
|
| **Rate Limits** | 100/1000 | 1000/10000 |
|
||||||
|
| **Deploy** | `kubectl apply -k k8s/app/` | `kubectl apply -f config.local.yaml` |
|
||||||
@@ -0,0 +1,47 @@
|
|||||||
|
# Local/Development configuration (plaintext, external URLs via ingress)
|
||||||
|
# Use this instead of config.yaml for local testing
|
||||||
|
# kubectl apply -f config.local.yaml
|
||||||
|
apiVersion: v1
|
||||||
|
kind: ConfigMap
|
||||||
|
metadata:
|
||||||
|
name: poimen-memory-config
|
||||||
|
namespace: poimen
|
||||||
|
labels:
|
||||||
|
app.kubernetes.io/name: poimen-memory
|
||||||
|
app.kubernetes.io/component: config
|
||||||
|
data:
|
||||||
|
# Auth mode: jwt | apikey | none (disabled for local testing)
|
||||||
|
MEM_AUTH_MODE: "none"
|
||||||
|
|
||||||
|
# Rate limiting (higher for testing)
|
||||||
|
MEM_RATE_LIMIT_INGEST: "1000"
|
||||||
|
MEM_RATE_LIMIT_QUERY: "10000"
|
||||||
|
MEM_IDEMPOTENCY_TTL_SECS: "86400"
|
||||||
|
|
||||||
|
# Embeddings
|
||||||
|
MEM_EMBEDDING_BATCH_SIZE: "32"
|
||||||
|
|
||||||
|
# Downstream services - external URLs via ingress
|
||||||
|
|
||||||
|
# LLM Service (via api.riotpiao.com ingress)
|
||||||
|
LLM_ENDPOINT: "https://api.riotpiao.com/v1/chat/completions"
|
||||||
|
LLM_API_BASE: "https://api.riotpiao.com/v1"
|
||||||
|
LLM_MODEL: "qwen:7b"
|
||||||
|
LLM_TIMEOUT_SECS: "60"
|
||||||
|
ENABLE_LLM_EXTRACTION: "true"
|
||||||
|
|
||||||
|
# OpenSearch (via ingress)
|
||||||
|
OPENSEARCH_HOST: "opensearch.riotpiao.com:443"
|
||||||
|
OPENSEARCH_SCHEME: "https"
|
||||||
|
OPENSEARCH_VERIFY_CERTS: "true"
|
||||||
|
|
||||||
|
# Authentik (via ingress - optional for local)
|
||||||
|
AUTHENTIK_ISSUER: "https://authentik.riotpiao.com/application/o/poimen/"
|
||||||
|
AUTHENTIK_VERIFY_SSL: "true"
|
||||||
|
|
||||||
|
# Temporal (via ingress)
|
||||||
|
TEMPORAL_ENDPOINT: "temporal.riotpiao.com:443"
|
||||||
|
TEMPORAL_NAMESPACE: "poimen"
|
||||||
|
|
||||||
|
# API Gateway (via ingress)
|
||||||
|
GATEWAY_URL: "https://api.riotpiao.com"
|
||||||
+32
-10
@@ -1,5 +1,7 @@
|
|||||||
# Non-sensitive environment variables for poimen-memory
|
# Production environment configuration for poimen-memory
|
||||||
# Change these without redeploying secrets.
|
# All services use cluster-internal DNS names
|
||||||
|
# This file is encrypted with SOPS in production
|
||||||
|
# For local dev, use plaintext version with external URLs
|
||||||
apiVersion: v1
|
apiVersion: v1
|
||||||
kind: ConfigMap
|
kind: ConfigMap
|
||||||
metadata:
|
metadata:
|
||||||
@@ -9,19 +11,39 @@ metadata:
|
|||||||
app.kubernetes.io/name: poimen-memory
|
app.kubernetes.io/name: poimen-memory
|
||||||
app.kubernetes.io/component: config
|
app.kubernetes.io/component: config
|
||||||
data:
|
data:
|
||||||
# Auth mode: jwt | apikey
|
# Auth mode: jwt | apikey | none
|
||||||
MEM_AUTH_MODE: "none"
|
MEM_AUTH_MODE: "jwt"
|
||||||
|
|
||||||
# Rate limiting
|
# Rate limiting
|
||||||
MEM_RATE_LIMIT_INGEST: "100"
|
MEM_RATE_LIMIT_INGEST: "100"
|
||||||
MEM_RATE_LIMIT_QUERY: "1000"
|
MEM_RATE_LIMIT_QUERY: "1000"
|
||||||
MEM_IDEMPOTENCY_TTL_SECS: "86400"
|
MEM_IDEMPOTENCY_TTL_SECS: "86400"
|
||||||
|
|
||||||
# Embeddings
|
# Embeddings
|
||||||
MEM_EMBEDDING_BATCH_SIZE: "32"
|
MEM_EMBEDDING_BATCH_SIZE: "32"
|
||||||
# OpenSearch
|
|
||||||
OPENSEARCH_HOST: "opensearch.poimen.svc.cluster.local:9200"
|
# Downstream services - read by application from ENV
|
||||||
# Obsidian
|
# Internal cluster DNS (prod) / external URLs (local)
|
||||||
# LLM Configuration (for entity extraction)
|
|
||||||
LLM_ENDPOINT: "http://api-internal.riotpiao.com:8000/v1/chat/completions"
|
# LLM Service (entity extraction, fact extraction)
|
||||||
LLM_MODEL: "qwen:7b"
|
LLM_ENDPOINT: "http://reasoning-predictor.llm-serving.svc.cluster.local:8000/v1/chat/completions"
|
||||||
|
LLM_API_BASE: "http://reasoning-predictor.llm-serving.svc.cluster.local:8000/v1"
|
||||||
|
LLM_MODEL: "ornith:35b"
|
||||||
LLM_TIMEOUT_SECS: "30"
|
LLM_TIMEOUT_SECS: "30"
|
||||||
ENABLE_LLM_EXTRACTION: "true"
|
ENABLE_LLM_EXTRACTION: "true"
|
||||||
|
|
||||||
|
# OpenSearch (vector store, BM25 retrieval)
|
||||||
|
OPENSEARCH_HOST: "opensearch.poimen.svc.cluster.local:9200"
|
||||||
|
OPENSEARCH_SCHEME: "http"
|
||||||
|
OPENSEARCH_VERIFY_CERTS: "false"
|
||||||
|
|
||||||
|
# Authentik (OIDC provider)
|
||||||
|
AUTHENTIK_ISSUER: "https://authentik.auth.svc.cluster.local:9443/application/o/poimen/"
|
||||||
|
AUTHENTIK_VERIFY_SSL: "false"
|
||||||
|
|
||||||
|
# Temporal (workflow orchestration - future)
|
||||||
|
TEMPORAL_ENDPOINT: "temporal-frontend.temporal.svc.cluster.local:7233"
|
||||||
|
TEMPORAL_NAMESPACE: "poimen"
|
||||||
|
|
||||||
|
# API Gateway (external queue, route optimization - future)
|
||||||
|
GATEWAY_URL: "http://api-gw.poimen.svc.cluster.local:8080"
|
||||||
|
|||||||
+6
-13
@@ -61,20 +61,12 @@ spec:
|
|||||||
- name: DATABASE_URL
|
- name: DATABASE_URL
|
||||||
value: "postgresql://$(DATABASE_USER):$(DATABASE_PASSWORD)@$(DATABASE_HOST):$(DATABASE_PORT)/$(DATABASE_NAME)?sslmode=disable"
|
value: "postgresql://$(DATABASE_USER):$(DATABASE_PASSWORD)@$(DATABASE_HOST):$(DATABASE_PORT)/$(DATABASE_NAME)?sslmode=disable"
|
||||||
|
|
||||||
# LLM via api.riotpiao.com (Authentik JWT auth)
|
# All downstream service URIs read from ConfigMap
|
||||||
- name: LLM_ENDPOINT
|
# (LLM_ENDPOINT, LLM_API_BASE, LLM_MODEL, OPENSEARCH_HOST, etc.)
|
||||||
value: "https://api.riotpiao.com/v1/chat/completions"
|
# These are injected via envFrom below
|
||||||
- name: LLM_API_BASE
|
|
||||||
value: "https://api.riotpiao.com/v1"
|
|
||||||
- name: LLM_MODEL
|
|
||||||
value: "ornith:35b"
|
|
||||||
|
|
||||||
# Authentik service account (memory-agent-oidc secret)
|
# Authentik service account (memory-agent-oidc secret)
|
||||||
- name: AUTHENTIK_ISSUER
|
# Only needed if MEM_AUTH_MODE=jwt in ConfigMap
|
||||||
valueFrom:
|
|
||||||
secretKeyRef:
|
|
||||||
name: memory-agent-oidc
|
|
||||||
key: ISSUER
|
|
||||||
- name: AUTHENTIK_CLIENT_ID
|
- name: AUTHENTIK_CLIENT_ID
|
||||||
valueFrom:
|
valueFrom:
|
||||||
secretKeyRef:
|
secretKeyRef:
|
||||||
@@ -102,6 +94,7 @@ spec:
|
|||||||
- name: MEM_HOME
|
- name: MEM_HOME
|
||||||
value: "/tmp"
|
value: "/tmp"
|
||||||
envFrom:
|
envFrom:
|
||||||
|
# ConfigMap with all service URIs (prod: encrypted, local: plaintext)
|
||||||
- configMapRef:
|
- configMapRef:
|
||||||
name: poimen-memory-config
|
name: poimen-memory-config
|
||||||
command: ["/app/mem"]
|
command: ["/app/mem"]
|
||||||
|
|||||||
@@ -1,13 +1,12 @@
|
|||||||
apiVersion: kustomize.config.k8s.io/v1beta1
|
apiVersion: kustomize.config.k8s.io/v1beta1
|
||||||
kind: Kustomization
|
kind: Kustomization
|
||||||
namespace: poimen
|
namespace: poimen
|
||||||
|
|
||||||
resources:
|
resources:
|
||||||
# vault-pvc.yaml removed — memory service uses pgvector, not local storage
|
|
||||||
- deployment.yaml
|
- deployment.yaml
|
||||||
- service.yaml
|
- service.yaml
|
||||||
- config.yaml
|
- config.yaml # Production config (SOPS-encrypted)
|
||||||
# obsidian.yaml retired — reference docs now via memory graph
|
# config.local.yaml # Optional: plaintext local/dev overrides
|
||||||
# Legacy secret managed separately
|
|
||||||
# - secrets.yaml
|
|
||||||
generators:
|
generators:
|
||||||
- secret-generator.yaml
|
- secret-generator.yaml
|
||||||
|
|||||||
Reference in New Issue
Block a user