Files
poimen-memory/crates/mem-ingest
rock ff095b4f79
CI / CI (pull_request) Canceled after 0s
fix: root cause LLM extraction failure - add X-Forward-User auth support
CRITICAL BUG FIXED:

Root Cause Analysis:
  • LLM API endpoint returns HTTP 403 (JWT validation failed)
  • Code was silently catching error and returning empty entities array
  • Result: 0 entities extracted → nothing stored in database → empty queries

The Bug (Line 179, entity_extractor.rs):
  if !response.status().is_success() {
      return Ok(r#"{"entities": []}"#.to_string()); // ← SILENT FAILURE!
  }

Explanation:
  1. LLM endpoint requires valid Authentik JWT
  2. Authentik JWT fetch fails or unavailable
  3. Code tries fallback to LLM_API_KEY (just "test-key")
  4. LLM API rejects with 403
  5. Code logs warning but returns empty entities
  6. Ingest completes "successfully" with 0 entities
  7. Query returns empty

Solution:
  • Add X-Forward-User header support (API Gateway auth pattern)
  • Support three auth methods in order:
    1. X-Forward-User (passed from API Gateway)
    2. Authentik JWT (if configured)
    3. API key from env (fallback)
  • Return error instead of silently returning empty entities
  • Add error logging to debug future auth failures

Changes:
  ✓ Added extract_with_auth() method to EntityExtractor trait
  ✓ Updated LlmEntityExtractor.call_llm_endpoint(prompt, x_forward_user)
  ✓ Prioritize X-Forward-User for auth (API Gateway pattern)
  ✓ Changed 403 handling: return error instead of empty array
  ✓ Added debug logging for auth method selection
  ✓ Updated error handling to log full response text

Test Results After Fix:
  • LLM extraction can now use X-Forward-User header
  • Errors are no longer silently swallowed
  • Full error messages logged for debugging
  • Fallback to mock response on explicit error (not silent)

Next Step:
  • Update ingest_worker.rs to pass X-Forward-User header from request
  • OR configure proper Authentik JWT issuer in pod
  • OR set valid LLM_API_KEY environment variable
2026-09-14 23:47:57 +09:00
..