feat(network): SSE optimization for local LLM streaming (#31 #32 #33) (#26)

Addresses three critical network issues for LLM streaming performance:

**#33 Disable proxy buffering for SSE**
- Add X-Accel-Buffering: no header to response
- Tells nginx/Ingress to stream events immediately instead of buffering

**#32 HTTP/2 multiplexing for concurrent streams**
- Enable HTTP/2 in server config via http2.ConfigureServer()
- Increase MaxConnsPerHost to 10 for better concurrency
- Allows multiple concurrent LLM requests without blocking

**#31 TCP backpressure for streaming LLM responses**
- Set TCP_NODELAY on dialer to disable Nagle's algorithm
- Reduces latency by sending small packets immediately
- Critical for low TTFT (time-to-first-token) under load

**Tests added:**
- TestTCPBackpressure: Verifies TCP backpressure handling with slow client
- TestConcurrentSSEStreams: Confirms HTTP/2 multiplexing works correctly

---------

Co-authored-by: poison <[email protected]>
Reviewed-on: #26
Co-authored-by: poimen <[email protected]>

README.md

@@ -38,22 +38,22 @@ Production API gateway for the homelab cluster. Single entry point (`api.riotpia
     │   (routing, auth, limits)    │
     └──────┬───────────────────────┘
            │
-    ┌──────┴──────────────────────────────────┐
-    │                                          │
- /v1/*         /workflow       /sqs          /
-(LLM)      (Temporal gRPC)   (Queues)   (X-Service)
-    │             │              │           │
-    ▼             ▼              ▼           ▼
-llm-serving  temporal:7233   kmsvc/Kafka  IAM, S3
-(vLLM, Ollama) (WorkflowService)            Memory
-(TEI)       (gRPC bridge)                   (poimen)
+    ┌──────┴───────────────────────────────────┐
+    │                                           │
+ /v1/*           X-Service header routing       /
+(LLM)    (workflow, sqs, s3, iam, memory)    /
+    │             │                           │
+    ▼             ▼                           ▼
+llm-serving  temporal:7233   kmsvc/Kafka, MinIO,
+(vLLM, Ollama) (gRPC)        Authentik, poimen-memory
+(TEI)
 ```
 
 **Design principles:**
-- ✅ Single hostname, multiple path prefixes
-- ✅ HTTP REST gateway → gRPC Temporal bridge
+- ✅ Single hostname, unified X-Service + X-Resource header routing
+- ✅ HTTP REST gateway → gRPC Temporal bridge (via X-Service: workflow)
 - ✅ Bearer token auth via Authentik (JWT + RBAC)
-- ✅ Streaming unbuffered (SSE, WebSocket)
+- ✅ Streaming unbuffered (SSE, WebSocket, HTTP/2 multiplexing)
 - ✅ Per-route timeouts & rate limits
 - ✅ No cluster credentials held by gateway
 
@@ -61,16 +61,16 @@ llm-serving  temporal:7233   kmsvc/Kafka  IAM, S3
 
 ## Services & Capabilities
 
-| Service | Prefix | Upstream | Status |
+| Service | Method | Upstream | Status |
 |---------|--------|----------|--------|
-| **LLM Chat** | `/v1/chat/completions` | llm-serving (vLLM) | ✅ Live |
-| **Embeddings** | `/v1/embeddings` | llm-serving (TEI) | ✅ Live |
-| **Reranking** | `/v1/rerank` | llm-serving (TEI) | ✅ Live |
-| **Workflows** | `/workflow` | Temporal gRPC (7233) | ✅ Live (START, DESCRIBE, SIGNAL, QUERY, etc) |
-| **Queues** | `/` + `X-Service: sqs` | kmsvc/Kafka | ⏳ Ready (ServiceAdapter) |
-| **Memory** | `/` + `X-Service: memory` | poimen-memory | ✅ Live |
-| **IAM** | `/` + `X-Service: iam` | Authentik API | ✅ Live |
-| **S3** | `/` + `X-Service: s3` | MinIO | ✅ Live |
+| **LLM Chat** | `POST /v1/chat/completions` | llm-serving (vLLM) | ✅ Live |
+| **Embeddings** | `POST /v1/embeddings` | llm-serving (TEI) | ✅ Live |
+| **Reranking** | `POST /v1/rerank` | llm-serving (TEI) | ✅ Live |
+| **Workflows** | `X-Service: workflow` + `X-Resource: {action}` | Temporal gRPC (7233) | ✅ Live (START, DESCRIBE, SIGNAL, QUERY, etc) |
+| **Queues** | `X-Service: sqs` + `X-Resource: {action}` | kmsvc/Kafka | ✅ Live |
+| **Memory** | `X-Service: memory` + `X-Resource: {action}` | poimen-memory | ✅ Live |
+| **IAM** | `X-Service: iam` + `X-Resource: {action}` | Authentik API | ✅ Live |
+| **S3** | `X-Service: s3` + `X-Resource: {action}` | MinIO | ✅ Live |
 
 ---
 
@@ -102,18 +102,17 @@ curl -X POST https://api.riotpiao.com/v1/chat/completions \
   }'
 ```
 
-**Workflow:**
+**Workflow (via X-Service header):**
 ```bash
-curl -X POST https://api.riotpiao.com/workflow \
+curl -X POST https://api.riotpiao.com/ \
   -H "Authorization: Bearer $TOKEN" \
+  -H "X-Service: workflow" \
+  -H "X-Resource: start" \
   -d '{
-    "action": "START_WORKFLOW",
     "namespace": "default",
-    "payload": {
-      "workflow_id": "my-workflow",
-      "workflow_type": "MyWorkflow",
-      "task_queue": "default"
-    }
+    "workflow_id": "my-workflow",
+    "workflow_type": "MyWorkflow",
+    "task_queue": "default"
   }'
 ```