Compare commits

..
Author SHA1 Message Date
rock b9f469a92f Merge pull request 'fix(gateway): stop routing clef-flash, the model cannot run here' (#73) from tmp-clef-check into main
CI / CI (push) Successful in 3m17s
2026-10-28 17:30:52 +00:00
Admin Bot 9ff41e3131 fix(gateway): stop routing clef-flash, the model cannot run here
CI / CI (pull_request) Successful in 2m7s
The model list still pointed clef-flash at clef-flash-predictor. That predictor is gone:
Clef needs SGLang v0.5.22+, published only on CUDA 13, and CUDA 13 dropped Volta
kernels. Every GPU is a Tesla V100 (sm_70), so SGLang aborts with 'no kernel image is
available'. SGLang's floor is sm75 regardless.

Advertising it meant a caller would wait for a Service with no endpoints until its own
timeout fired, instead of failing clearly. Remove the entry and keep the reasoning in
its place, so restoring it later is a deliberate act tied to new hardware.
2026-10-28 10:30:30 -07:00
Admin Bot c14b9650cd feat(gateway): allow the two machine callers, in the source of truth
CI / CI (pull_request) Successful in 2m45s
CI / CI (push) Successful in 3m32s
The live Secret carried a hand-written entry for poimen-llm, which a reconcile would
have dropped: the config Secret is managed from this file.

Add poimen-llm and paperless-llm to zitadelClientIds, and switch on
allowListedMachineIdentities so an allow-listed caller is admitted without a roles
claim. ZITADEL does not put roles in a machine-user token on this instance, so the
allow-list entry is what authorises the caller; the caller still proves possession of a
registered private key.
2026-10-28 00:13:10 -07:00
File diff suppressed because one or more lines are too long