7 Commits

Include renames

Author	SHA1	Message	Date
Story Crater Bot	edcc23122e	feat: M3.8.1 phase 3 — CacheAligner + CCR Store (18 tests) ... CacheAligner (180 LOC, 8 tests): - Detects dynamic patterns: timestamps, UUIDs, session IDs, temp paths, SHAs - Uses once_cell Lazy statics + Regex for pattern matching - Separates stable prefix (cache-able) from dynamic tail (varies) - Reports drift metrics (0.0-1.0 ratio of dynamic content) - Preserves identical prefixes across calls for KV cache hits CcrStore (170 LOC, 10 tests): - LRU cache with IndexMap (preserves insertion order) - SHA256 hashing for content identification - TTL-based expiry (default 1hr, configurable) - Thread-safe (Mutex-wrapped) - Supports large content (tested 100KB+) ContextOptimizer integration (2 tests): - Wired CCR store into optimizer - Stores originals when compression occurs + CCR enabled - Returns hash for retrieval hints 50 optimizer tests total: Phase 1 (17) + Phase 2 (15) + Phase 3 (18) = 50 passing	2026-08-28 09:39:31 -07:00
Story Crater Bot	a903a3ffcb	feat: M3.8.1 phase 2 — JSON + Diff compressors (15 tests) ... JsonCrusher (300 LOC): - Field variance analysis for mid-array selection - Allocation: 30% start (schema), 15% end (recency), 55% importance - Truncates long strings (>500 chars) with markers - Handles nested structures recursively DiffCompressor (180 LOC): - Keeps: file headers, hunk markers (@@), change lines (+/-) - Drops: context lines (spaces), unchanged content - Preserves binary file markers 32 optimizer tests total (17 phase1 + 15 phase2): - JsonCrusher: 8 tests (object, array, boundaries, truncation, nesting) - DiffCompressor: 7 tests (simple, multiple hunks, new/deleted files)	2026-08-28 09:36:17 -07:00
Story Crater Bot	05aec4e23b	feat: M3.8.1 phase 1 — content router + log compressor ... ContentRouter uses Google Magika ML for content detection (<1ms) with regex fallback. Detects JSON, code, logs, diffs, config, text. LogCompressor reuses M3.7.7 patterns (markers, cascade, strip_ansi) to shrink build logs by keeping errors/stacks and dropping noise. 17 unit tests passing: - router: json, code, diff, log, text detection - log: error lines, stack traces, ansi stripping, compression - optimizer: token estimation, passthrough mode Magika + ort ONNX runtime added to Cargo.toml.	2026-08-28 09:29:56 -07:00
Story Crater Bot	a45263410f	feat: add cache-aligned prompt builder for LLM API cost savings ... PROBLEM: - PromptBuilder.build() puts everything in a single user message - System + query + memory + chunk all change together - LLM prompt caching gets 0% hits (entire message differs per call) - For a 50-chunk ingestion run, we pay full input price 50 times SOLUTION: PromptBuilder.build_cache_aligned() - Splits prompt into 3 separate messages: 1. SYSTEM: instructions (stable across ALL calls) → CACHED 2. USER[0]: query/problem (stable per run) → CACHED 3. USER[1]: memory + chunk (varies per call) → not cached - Cache prefix (system + query) reused across all chunks in a run - Estimated 30-70% cache hit ratio depending on chunk sizes - ~50% input token cost savings for multi-chunk ingestion TEMPLATES: - templates/gru-mem-system.txt (instructions only, 840B) - templates/gru-mem-query.txt (problem wrapper, 29B) - templates/gru-mem-turn.txt (memory + section, 57B) - templates/gru-mem.txt (legacy, unchanged) API: - PromptBuilder::build() — legacy, backward compatible - PromptBuilder::build_cache_aligned() → PromptMessages - PromptMessages.cache_prefix_tokens() — cacheable token count - PromptMessages.total_tokens() — total estimated tokens - PromptMessages.headroom() — tokens available for response TESTS: 11 unit + 3 integration = 14 new tests - test_cache_aligned_produces_two_user_messages - test_cache_prefix_is_stable_across_chunks - test_cache_prefix_is_stable_across_memory_changes - test_cache_prefix_tokens_positive - test_headroom_positive_under_budget - test_legacy_build_still_works - test_cache_aligned_contains_query - test_cache_aligned_memory/chunk_budget_exceeded - a8_cache_prefix_stable_across_50_chunks - a9_cache_aligned_headroom - a10_cache_savings_estimate TOTAL: 64 mem-core tests passing (52 unit + 12 integration)	2026-08-28 08:24:38 -07:00
Story Crater Bot	0478692919	feat: implement M3.7.8 symptom projection (250 LOC) + 22 tests (10 unit + 12 integration) ... IMPLEMENTATION: - crates/mem-core/src/symptom_projection.rs (250 LOC) - project_symptom(tool, query) → SymptomVector - Three-stage normalization: - Stage 1: Extract keywords - Stage 2: Normalize (stop words, abbreviations) - Stage 3: Generate deterministic SHA256 hash - Tool-specific abbreviation mappings (npm, cargo, kubectl, docker, go) - Stop words list (30+ common words) - Confidence scoring based on keyword specificity TEST COVERAGE: 22 tests passing - 10 unit tests in lib (determinism, abbreviations, stop words, tools, case, order) - 12 integration tests (a1-a6 assertions from design doc) - Real-world scenario tests (npm, cargo, kubectl) - 100% deterministic hashing verified INTEGRATION: - Module exported in crates/mem-core/src/lib.rs - All 43 existing mem-core tests still passing - Ready for M3.7.4 context endpoint integration DESIGN ASSERTIONS (all passing): ✅ a1: Same symptom = same hash (deterministic) ✅ a2: Abbreviation expansion (ERESOLVE → error resolve) ✅ a3: Stop word removal (is, unable, to, the) ✅ a4: Tool consistency (npm ≠ cargo for same error) ✅ a5: Case insensitive (NPM = npm) ✅ a6: Keyword order irrelevant (sorted before hash)	2026-08-28 08:08:55 -07:00
Story Crater Bot	d3be7f6fd4	Deploy Poimen Memory K8s cluster with ArgoCD tracking (M2.2, M3.5-M3.7)	2026-08-22 23:13:42 -07:00
Story Crater Bot	631cbfa3e9	feat: complete M0.1-M0.4 phases ... M0.1 - Cargo workspace + crate skeletons - 6-crate workspace with correct dependency direction - CI/CD pipeline with GitHub Actions - Integration tests verifying build and dependency structure M0.2 - Domain types and sha256 identity - Level (L0, L1, L2) enum with proper serde formatting - Role enum (User, Assistant, ToolResult, System) - Record, Chunk, and MemoryNode domain types - Content-hash identity system ensuring rebuild idempotence - Newtypes (ProjectId, QueryId, RunId) with validation - Round-trip serde tests for all types M0.3 - RecordSource trait + ChunkPolicy - RecordSource trait for streaming record sources - Chunk policy with token budgets and boundary modes - TokenCounter trait with CharsOverFourCounter stub - Chunking stream that respects budgets without splitting records - VecSource for testing - Integration tests verifying lossless chunking and budget adherence M0.4 - Tokenizer-backed chunk sizing - Vendored Qwen2 tokenizer with hash verification - QwenTokenCounter implementing proper token counting - Hash guard that fails on modified tokenizer - mem tokens CLI subcommand for token counting - Integration tests with known string counts, hash guards, and budget verification Total: 19 integration tests passing, all phases verified to compose correctly Workspace builds cleanly with no clippy warnings	2026-08-22 23:13:42 -07:00