poimenandrock
a88ea918bf
## Summary
Production testing of ingest + embedding pipeline with api-gw integration.
## Root Cause
9 SQL migrations in `crates/mem-store/migrations/` not applied to production database.
Missing tables:
- `memory_entity`
- `memory_edge`
- `memory_edge_temporal`
- Vector embeddings tables
- And 15+ more schema objects
Evidence from logs:
```
WARN: Failed to save entity Docker:
error returned from database: relation "memory_entity" does not exist
```
## Deliverables
- `test_prod_ingest_real.sh` - Full E2E test against K8s + api-gw
- `apply_migrations.sh` - Manual schema migration (backup)
- `collect_prod_logs.sh` - Pod log collection before/after
- `run_production_test.sh` - Test orchestrator
- `tests/integration_ingest_with_gw.rs` - Integration test
- `tests/unit_ingest_logging.rs` - Unit tests for extraction
- Enhanced logging in `ingest_worker.rs` - Per-record event tracking
## Next Steps
1. Trigger "DB Migration" workflow in Forgejo Actions
2. This applies all 9 migrations from `crates/mem-store/migrations/`
3. Pod restart (automatic)
4. Re-run E2E test - should pass completely
**ETA:** ~15 minutes (3-5 min migrations + 2 min restart + verification)
## How to Test Locally
```bash
./test_prod_ingest_real.sh --verbose
```
Requires:
- kubectl access to poimen namespace
- Port-forwarding to memory-service
---------
Co-authored-by: rock <[email protected]>
Reviewed-on: #55
Co-authored-by: poimen <[email protected]>
20 lines
535 B
Bash
20 lines
535 B
Bash
MEM_AUTH_MODE=none
|
|
MEM_RATE_LIMIT_INGEST=1000
|
|
MEM_RATE_LIMIT_QUERY=10000
|
|
MEM_IDEMPOTENCY_TTL_SECS=86400
|
|
MEM_EMBEDDING_BATCH_SIZE=4
|
|
|
|
DATABASE_URL=postgresql://app:***REMOVED***@127.0.0.1:5433/memory
|
|
|
|
# Embedding via direct port-forward (skip gateway auth)
|
|
LLM_ENDPOINT=http://localhost:9090/v1/chat/completions
|
|
LLM_API_BASE=http://localhost:9090
|
|
LLM_MODEL=nomic-ai/nomic-embed-text-v2-moe
|
|
LLM_TIMEOUT_SECS=60
|
|
ENABLE_LLM_EXTRACTION=true
|
|
EMBEDDINGS_MODEL=nomic-ai/nomic-embed-text-v2-moe
|
|
|
|
MEM_PORT=8081
|
|
MEM_API_KEY=test-key
|
|
MEM_HOME=/tmp
|