feat: Archive M3.8 (6/6 complete) - context optimization phase done

This commit is contained in:
2026-08-28 13:41:25 -07:00
parent fd9f73230a
commit 68d544e31e
4 changed files with 181 additions and 366 deletions
+12 -11
View File
@@ -66,12 +66,12 @@ Legend: ⬜ not started · 🟡 in progress · ✅ done · ⛔ blocked
| 5 | Skills | M4.x | 3 | 2 | 0 | 1 | ⬜ M4.3 |
| 5.5 | Reference corpora | M3.6.x | 7 | 1 | 0 | 6 | ⬜ M3.6.8 |
| 5.6 | Tool context | M3.7.x | 4 | 2 | 0 | 2 | ⬜ M3.7.6 |
| 5.7 | Context optimization | M3.8.x | 4 | 4 | 0 | 0 | ✅ M3.8.4 |
| 5.7 | Context optimization | M3.8.x | 6 | 6 | 0 | 0 | ✅ M3.8.6 |
| 6 | Post-training | M5.x | 6 | 0 | 0 | 6 | ⬜ M5.6 |
| 7 | agent-manager migration | M6.x | 6 | 0 | 0 | 6 | ⬜ M6.6 |
| 8 | Source connectors | M7.x | 10 | 0 | 0 | 10 | ⬜ M7.10 |
| 9 | Hybrid search | M8.x | 9 | 9 | 0 | 0 | ✅ M8.9 |
| | **Total** | | **78** | **75** | **0** | **3** | 9/13 green |
| | **Total** | | **65** | **60** | **0** | **5** | 10/13 green |
**Current status — 2025-01-28.** Completed phases M0.x, M1.x fully archived (16/16 tasks). **M2.1-6 ✅** (embeddings, CNPG, schema, pgvector, obsidian projector, rebuild). **M3.x ✅** (4/4). **M3.5.x ✅** (10/10 complete + archived). **M3.7.7-8 ✅** (failure diagnosis). **M4.1-2 ✅** (skill drafting + derived filter). **M3.6.1 ✅** (DocCorpusSource). **M3.6.3 ❌ retired** (Obsidian UI replaces CLI). **M3.6.7-8 ⬜ new** (ingest enrichment + deduplication). **M8.1 🟡** (OpenSearch cluster deploying — security context fixes in progress).
@@ -199,20 +199,21 @@ Ids are `M3.7.x` and frozen. `M3.7.1`, `M3.7.2`, `M3.7.3`, `M3.7.5` retired.
| M3.7.7 | Failure signature extraction + normalisation | M | — | ✅ ARCHIVED |
| M3.7.8 | Symptom projection at ingest | M | — | ✅ ARCHIVED |
## 5.7 — Context optimization · M3.8.x
## ✅ Archived Phase 5.7 — Context optimization · M3.8.x
**Status:** ✅ Complete · 6/6 done. All task files archived.
Headroom-inspired pre-LLM compression. Sits between hybrid search retrieval
and the LLM gateway. Search indexes (pgvector + OpenSearch) stay at full
fidelity; only evidence chunks entering the prompt get optimized.
| Task | Title | Size | Flags | Status |
|---|---|---|---|---|
| [M3.8.1](M3.8.1-context-optimizer.md) | Core compressor modules | L | — | ✅ COMPLETE (62 tests) |
| [M3.8.2](M3.8.2-cache-aligner-headers.md) | Ingest integration helpers | M | — | ✅ COMPLETE (5 tests) |
| [M3.8.3](M3.8.3-compression-benchmarks.md) | Metrics & monitoring | M | — | ✅ COMPLETE (7 tests) |
| [M3.8.4](M3.8.4-m3.8-gate.md) | Query cleanup (implicit) | S | — | ✅ COMPLETE |
| [M3.8.5](M3.8.5-compression-benchmarks.md) | Compression & search benchmarks | M | — | ⬜ ACTIVE (16 tests) |
| [M3.8.6](M3.8.6-m3.8-gate.md) | **M3.8 composition gate** | M | gate | ⬜ PENDING (13 tests) |
M3.8.1-M3.8.6 ✅ ARCHIVED:
- M3.8.1 ✅ (Core compressor modules: router, log, json, diff, text, config)
- M3.8.2 ✅ (Ingest pipeline integration: OptimizerSink wrapper)
- M3.8.3 ✅ (Metrics & monitoring: compression ratios, per-compressor stats)
- M3.8.4 ✅ (Query cleanup: removed optimizer from PromptBuilder)
- M3.8.5 ✅ (Compression benchmarks: validated compression ratios)
- M3.8.6 ✅ (M3.8 composition gate: verified end-to-end pipeline)
## 6 — Post-training · M5.x