Story Crater BotandClaude Opus 5
058f11cf2b
Baseline for the Kong replacement on api.riotpiao.com. Brings the working tree under version control for the first time: gateway source, the task board that drives the agent runs, test fixtures, and K8s manifests. Anchor the gateway ignore rule to the repo root. Unanchored, "gateway" also matched the cmd/gateway/ source directory, so the program entrypoint was excluded from every commit. Co-Authored-By: Claude Opus 5 (1M context) <[email protected]>
1.3 KiB
1.3 KiB
2.6 — POST /v1/embeddings passthrough (GREEN)
Phase: 2 — LLM surface Stage: GREEN Depends on: 2.1, 1.1
POST /v1/embeddingsreachesembeddings-predictor.llm-serving:80at the path/v1/embeddings, unrewritten- The request body is forwarded byte-identical, and the upstream response body is returned byte-identical
- The route's connect timeout is 10s and its read and write timeouts are 10m, explicit in configuration rather than inherited
- The route has an explicit body size cap
- Upstream error statuses are surfaced as-is; the gateway invents no retries and no substitute response
TEI already serves the canonical path, so this route rewrites nothing. The model
served here is nomic-ai/nomic-embed-text-v2-moe. Port is 80, not 8080. Whether this
route dispatches on the body's model or is pinned to the single embeddings upstream
is a design decision for whoever works it; either way the path must not change and an
unknown model must not silently reach the wrong upstream.
Verify
curl -s -i localhost:8080/v1/embeddings -H 'content-type: application/json' \
-d '{"model":"nomic-ai/nomic-embed-text-v2-moe","input":"hello"}'
# expected: 200, embeddings stub hit at path /v1/embeddings, request body unmodified, response body byte-identical to the stub's