Commit Graph
3 Commits
Author SHA1 Message Date
Admin Bot c93bfca6a8 fix: go vet errors in observability metrics
CI / CI (pull_request) Successful in 4m9s
- Remove unused avg variable in prometheus.go
- Fix import ordering in llm_metrics.go (move net/http to top)
2026-09-15 00:50:41 +09:00
Admin Bot 44ec3502dc feat: add TTFT/ITL metrics for LLM inference
CI / CI (pull_request) Failing after 2m13s
- RecordTTFT: Time-to-First-Token in milliseconds
- RecordITL: Inter-Token Latency in milliseconds
- RecordTokenCount: Track total tokens generated
- Prometheus exporter for /metrics endpoint
- Grafana dashboard ConfigMap (llm-metrics.json)
- ResponseWriterWrapper to capture metrics during LLM calls
- Metrics exported: llm_ttft_seconds, llm_itl_seconds, llm_tokens_total
2026-09-14 22:33:32 +09:00
Admin Bot 425611ec42 feat: phase 8 serviceadapter crd rollout (32/33 tasks) 2026-08-26 13:47:36 -07:00