feat: LLM entity + fact extraction pipeline (Zep paper alignment) (#48)
## Changes
### Entity Extraction
- Switch from WikiLinkFallbackExtractor to LlmEntityExtractor when LLM_ENDPOINT set
- `clean_llm_response()`: strips `<think>` tags, markdown fences, extracts JSON
- Handle array responses (Ollama returns `[...]` not `{entities: [...]}`)
- EntityType custom Deserialize: unknown variants → Unknown (no crash)
- Increase timeout 30s→90s, max_tokens 500→1500 for reasoning models
- Graceful reflection fallback: keep entities if verification fails
### Fact Extraction (NEW)
- LlmFactExtractor: LLM-based relationship extraction between entity pairs
- Validates source/target against known entity list (drops hallucinated edges)
- Same robust JSON cleaning for reasoning models + Ollama
- IngestWorker auto-selects LLM vs Simple based on LLM_ENDPOINT env
### K8s Deployment
- Add `command: ["/app/mem"]` (fix args replacing CMD)
- Add LLM_ENDPOINT, LLM_MODEL env vars for in-cluster LLM
## E2E Tested (local Ollama qwen2.5:3b)
- 12 entities extracted (person, tool, concept, organization)
- 5 edges with relationships and facts
- 781 tests pass
## Zep Paper Alignment (§2.2)
- Entity extraction + resolution (§2.2.1)
- Fact extraction between entity pairs (§2.2.2)
- Temporal edge invalidation ready (t_valid/t_invalid schema)
- Reflection verification (§2.2.1, graceful fallback)
---------
Co-authored-by: rock <[email protected]>
Reviewed-on: #48
Co-authored-by: poimen <[email protected]>
This commit was merged in pull request #48.
This commit is contained in:
@@ -344,6 +344,22 @@ impl FullPipeline {
|
||||
|
||||
metrics.total_latency_ms = start.elapsed().as_millis() as u64;
|
||||
|
||||
tracing::info!(
|
||||
target: "observability",
|
||||
event = "full_pipeline_complete",
|
||||
query = query,
|
||||
candidates = metrics.wiki_scope_docs,
|
||||
prefiltered = metrics.prefilter_candidates,
|
||||
optimized = metrics.post_optimization_count,
|
||||
dedup_removed = metrics.dedup_removed,
|
||||
boosts_applied = metrics.metadata_boosts_applied,
|
||||
cache_hit_ratio = format!("{:.2}", metrics.cache_hit_ratio),
|
||||
budget_bytes = metrics.budget_used_bytes,
|
||||
total_ms = metrics.total_latency_ms,
|
||||
"Full query pipeline complete"
|
||||
);
|
||||
|
||||
|
||||
Ok(PipelineResult {
|
||||
query: query.to_string(),
|
||||
query_intent,
|
||||
@@ -467,6 +483,22 @@ impl FullPipeline {
|
||||
|
||||
metrics.total_latency_ms = start.elapsed().as_millis() as u64;
|
||||
|
||||
tracing::info!(
|
||||
target: "observability",
|
||||
event = "full_pipeline_complete",
|
||||
query = query,
|
||||
candidates = metrics.wiki_scope_docs,
|
||||
prefiltered = metrics.prefilter_candidates,
|
||||
optimized = metrics.post_optimization_count,
|
||||
dedup_removed = metrics.dedup_removed,
|
||||
boosts_applied = metrics.metadata_boosts_applied,
|
||||
cache_hit_ratio = format!("{:.2}", metrics.cache_hit_ratio),
|
||||
budget_bytes = metrics.budget_used_bytes,
|
||||
total_ms = metrics.total_latency_ms,
|
||||
"Full query pipeline complete"
|
||||
);
|
||||
|
||||
|
||||
Ok(PipelineResult {
|
||||
query: query.to_string(),
|
||||
query_intent,
|
||||
|
||||
Reference in New Issue
Block a user