Story Crater Bot
d0a8caaad8
QueryOptimizer implements query-time optimization:
- Async optimize_chunk(chunk) before LLM processing
- Batch optimize_chunks() for multiple results
- Graceful fallback: original on optimization failure
- Metrics tracking for cache alignment analysis
Features:
✓ Content-type inference (JSON/logs/diffs/text)
✓ Environment-driven configuration
✓ Optional service integration
✓ Batch processing support
✓ Metrics calculation
Tests (7 passing):
- Disabled optimizer behavior
- Environment variable handling
- Async chunk optimization
- Content-type inference (JSON, logs, diffs, text)
- Metrics calculation
Build: ✅ mem-core (137 tests total, 7 new)
Ready to wire:
1. Ingest path: optimize_record_with_metrics() in rebuild.rs
2. Query path: QueryOptimizer.optimize_chunks() before LLM context
Architecture:
Ingest: Content → M3.8 compress → clean → embed + index
Query: Search → M3.8 optimize → clean → LLM context
Next: Wire into rebuild.rs and query_executor.rs