rockandpoimen d439536ca9 Add TTFT & ITL Metrics for LLM Inference (#28) ...

Time-to-First-Token (TTFT) and Inter-Token Latency (ITL) metrics for LLM inference observability

Metrics: llm_ttft_seconds, llm_itl_seconds, llm_tokens_total

Closes #31 #32 #33

---------

Co-authored-by: poimen <[email protected]>
Reviewed-on: #28

2026-09-15 08:53:58 +00:00

..

auth_config_test.go

feat(config): add tokenUrl, clientId, clientSecret to auth config (#17)

2026-09-08 23:43:29 +00:00

auth_required_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

config_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

config.go

Add TTFT & ITL Metrics for LLM Inference (#28)

2026-09-15 08:53:58 +00:00

integration_test.go

fix(deps,ci): update module path to forgejo.riotpiao.com/rock/homelab-frontend, switch to GITHUB_TOKEN

2026-08-21 20:46:45 -07:00

loader.go

Add TTFT & ITL Metrics for LLM Inference (#28)

2026-09-15 08:53:58 +00:00

models_test.go

feat(auth): wire JWT validation into /v1/* LLM endpoints

2026-08-31 23:01:59 -07:00