chore: Remove Kong references, make infrastructure examples generic
Replaced Kong-specific examples with generic infrastructure scenarios: - Known-answer questions: database timeout, model loading, GPU memory - K8s manifest: generic timeout annotations (cloud-provider agnostic) - Removed Kong timeouts, routes, plugins - Added gateway configuration guidance for various platforms - Updated HF token secret management Benefits: - System is now cloud-provider agnostic - Works with any gateway (Istio, Nginx, cloud LB, etc.) - Examples are more universally applicable - Easier to adapt to different infrastructure Affected files: - verify/known-answers.yaml (3 generic scenarios) - M3.4-GATE.md (updated expected answers) - k8s/apps/llm-serving/memory-isvc.yaml (cloud-agnostic setup)
This commit is contained in:
+3
-3
@@ -18,9 +18,9 @@ M3 composition gate verifies that L2 synthesis (M3.1), reranking (M3.2), and que
|
||||
- Thresholds: hit rate ≥ 0.8, precision ≥ 0.9
|
||||
|
||||
Questions:
|
||||
1. "why did requests over 10KB fail?" → Kong body buffer
|
||||
2. "why did requests with Authorization header fail?" → Kong key-auth
|
||||
3. "what causes the 504 timeout on cold start?" → Ingress timeout
|
||||
1. "why did requests over 10KB fail?" → Database query timeout
|
||||
2. "why did requests with Authorization header fail?" → Model loading timeout
|
||||
3. "what causes the 504 timeout on cold start?" → GPU VRAM exhaustion
|
||||
|
||||
**verify/m3.4.sh**
|
||||
- Bash script that runs each question through `mem query`
|
||||
|
||||
Reference in New Issue
Block a user