Admin Bot e5a1f052a4 feat: add TTFT/ITL metrics for LLM inference ...

- RecordTTFT: Time-to-First-Token in milliseconds
- RecordITL: Inter-Token Latency in milliseconds
- RecordTokenCount: Track total tokens generated
- Prometheus exporter for /metrics endpoint
- Grafana dashboard ConfigMap (llm-metrics.json)
- ResponseWriterWrapper to capture metrics during LLM calls
- Metrics exported: llm_ttft_seconds, llm_itl_seconds, llm_tokens_total

2026-09-15 15:14:13 +09:00

..

auth_endpoints_test.go

feat(proxy): add /auth/token and /auth/refresh endpoints (#18)

2026-09-09 00:00:07 +00:00

auth_endpoints.go

feat(proxy): add /auth/token and /auth/refresh endpoints (#18)

2026-09-09 00:00:07 +00:00

bodydispatch_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

bodysize_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

embeddings_and_rerank_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

headers_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

llm_metrics.go

feat: add TTFT/ITL metrics for LLM inference

2026-09-15 15:14:13 +09:00

models_endpoint_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

proxy_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

proxy.go

feat(network): SSE optimization for local LLM streaming (#31 #32 #33) (#26)

2026-09-13 23:37:33 +00:00

router.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

streaming_test.go

feat(network): SSE optimization for local LLM streaming (#31 #32 #33) (#26)

2026-09-13 23:37:33 +00:00

timeout_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

token_exchange_test.go

feat(proxy): add /auth/exchange token exchange endpoint

2026-09-09 00:31:10 +00:00

token_exchange.go

feat(proxy): add /auth/exchange token exchange endpoint

2026-09-09 00:31:10 +00:00

toolcall_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

unknown_model_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00