Poimen Ingest Pipeline

Poimen Ingest Pipeline A data-flow diagram generated by Archify. 01 / Input 02 / Extract 03 / Store 04 / Serve Episode · conversation text · 01 / Input · messages Episode conversation text messages Entity Extractor · LLM + reflection · 02 / Extract · person / tool Entity Extractor LLM + reflection person / tool Fact Extractor · LLM relationships · 02 / Extract · edges Fact Extractor LLM relationships edges Temporal Graph · pgvector · 03 / Store · HNSW Temporal Graph pgvector HNSW Query API · hybrid search · 04 / Serve · BFS + cosine Query API hybrid search BFS + cosine Visualization · React Flow · 04 / Serve · graph UI Visualization React Flow graph UI text ingest text ingest persist nodes write persist edges write search read graph data read Legend primary data async batch data store data flow

Extraction

  • • LLM extracts entities with type + summary
  • • Second LLM call extracts edges between entities
  • • Reflection filters hallucinated entities

Storage

  • • Temporal graph with bi-temporal edges
  • • 768-dim HNSW embeddings for similarity

Retrieval

  • • BFS traversal + cosine similarity
  • • React Flow JSON for interactive graph