rockandpoimen d439536ca9 Add TTFT & ITL Metrics for LLM Inference (#28) ...

Time-to-First-Token (TTFT) and Inter-Token Latency (ITL) metrics for LLM inference observability

Metrics: llm_ttft_seconds, llm_itl_seconds, llm_tokens_total

Closes #31 #32 #33

---------

Co-authored-by: poimen <[email protected]>
Reviewed-on: #28

2026-09-15 08:53:58 +00:00

..

adapters.go

feat(network): SSE optimization for local LLM streaming (#31 #32 #33) (#26)

2026-09-13 23:37:33 +00:00

real_integration_test.go

feat: Phase 3.1 - SQS JWT validation against Authentik JWKS

2026-08-27 11:40:35 -07:00

registry_test.go

feat: phase 8 serviceadapter crd rollout (32/33 tasks)

2026-08-26 13:47:36 -07:00

registry.go

feat: phase 8 serviceadapter crd rollout (32/33 tasks)

2026-08-26 13:47:36 -07:00

router_test.go

feat(serviceadapter): enforce JWT auth on X-Service dispatch (#16)

2026-09-08 23:20:31 +00:00

router.go

Add TTFT & ITL Metrics for LLM Inference (#28)

2026-09-15 08:53:58 +00:00

types.go

Add TTFT & ITL Metrics for LLM Inference (#28)

2026-09-15 08:53:58 +00:00

validate_test.go

feat: phase 8 serviceadapter crd rollout (32/33 tasks)

2026-08-26 13:47:36 -07:00

validate.go

feat: phase 8 serviceadapter crd rollout (32/33 tasks)

2026-08-26 13:47:36 -07:00

workflow_adapter.go

Add TTFT & ITL Metrics for LLM Inference (#28)

2026-09-15 08:53:58 +00:00