riotpiao-poimen/poimen-memory
2
0
Fork 0
Code Issues 13 Pull Requests Actions Packages Projects Releases Wiki Activity

O8: Ingest rate pattern tracking (IR1-IR10) #34

New Issue
Open
opened 2026-09-08 05:01:20 +00:00 by rock · 0 comments
rock commented 2026-09-08 05:01:20 +00:00
Owner
Copy Link
Copy Source

Track ingest rate patterns for capacity planning and anomaly detection.

Metrics:

  • IR1: ingest_rate_1m (Gauge, chunks/min)
  • IR2: ingest_rate_1h (Gauge, chunks/hour)
  • IR3: ingest_rate_by_project (Gauge, labeled)
  • IR4: ingest_rate_by_level (Gauge, labeled L0/L1/L2/R)
  • IR5: ingest_rate_by_source (Gauge, labeled transcript/document/api/batch)
  • IR6: ingest_batch_size (Histogram)
  • IR7: ingest_queue_depth (Gauge)
  • IR8: ingest_queue_age_seconds (Histogram)
  • IR9: ingest_bytes_per_chunk (Histogram)
  • IR10: ingest_throughput_bytes_per_second (Gauge)

Alerts:

  • IR2 = 0 for 30min during business hours (Warning — silent upstream failure)
  • IR1 > 200 sustained 10min (Warning — burst)
  • IR7 > 1000 for 15min (Critical — workers can't keep up)
  • IR8 p99 > 300s (Warning — 5min processing lag)

Reference: docs/OBSERVABILITY.md Section 8

Track ingest rate patterns for capacity planning and anomaly detection. Metrics: - IR1: ingest_rate_1m (Gauge, chunks/min) - IR2: ingest_rate_1h (Gauge, chunks/hour) - IR3: ingest_rate_by_project (Gauge, labeled) - IR4: ingest_rate_by_level (Gauge, labeled L0/L1/L2/R) - IR5: ingest_rate_by_source (Gauge, labeled transcript/document/api/batch) - IR6: ingest_batch_size (Histogram) - IR7: ingest_queue_depth (Gauge) - IR8: ingest_queue_age_seconds (Histogram) - IR9: ingest_bytes_per_chunk (Histogram) - IR10: ingest_throughput_bytes_per_second (Gauge) Alerts: - IR2 = 0 for 30min during business hours (Warning — silent upstream failure) - IR1 > 200 sustained 10min (Warning — burst) - IR7 > 1000 for 15min (Critical — workers can't keep up) - IR8 p99 > 300s (Warning — 5min processing lag) Reference: docs/OBSERVABILITY.md Section 8
rock added the memory-observability label 2026-09-08 05:01:20 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
memory-observability
Observability implementation tasks
No labels memory-observability
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
poimen rock (Rock)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: riotpiao-poimen/poimen-memory#34