[Network] HTTP/2 multiplexing for concurrent streams #32

Open
opened 2026-09-11 01:26:16 +00:00 by poimen · 0 comments
Member

Problem

Browsers cap HTTP/1.1 to 6 concurrent connections, blocking concurrent LLM streams.

Investigation

  • Gateway serves HTTP/1.1 behind ingress-nginx
  • No H2 config in gateway or ingress

Resolution

Enable HTTP/2 on ingress-nginx backend + gateway TLS. Verify with curl --http2.

Files

  • k8s/deployment.yaml
  • ingress-nginx ConfigMap
## Problem Browsers cap HTTP/1.1 to 6 concurrent connections, blocking concurrent LLM streams. ## Investigation - Gateway serves HTTP/1.1 behind ingress-nginx - No H2 config in gateway or ingress ## Resolution Enable HTTP/2 on ingress-nginx backend + gateway TLS. Verify with `curl --http2`. ## Files - `k8s/deployment.yaml` - ingress-nginx ConfigMap
poimen added this to the LLM Production Hardening milestone 2026-09-11 01:26:16 +00:00
Sign in to join this conversation.