What bank security teams demand before approving LLMs: a six-point gateway checklist
Pleasant-Whole-3220 · reddit · 2026-11-17
A practitioner building a self-hosted LLM gateway shares how banks in Turkey hit the same walls: scattered provider API keys, runaway bills, no audit trail, and no answer to 'what stops someone pasting customer data into a prompt?'. Requirements before rollout: a single internal endpoint so apps never hold provider keys; per-project/key/user/model limits with hard monthly budgets; secret scanning and PII masking before requests leave the network; all checks run before the model call so blocked requests cost nothing; tamper-evident audit logs feeding the existing SIEM; everything self-hosted rather than a SaaS proxy. Asks how others solved it: in-house, LiteLLM/Portkey, cloud gateway, and what auditors unexpectedly demanded.
More from coding & agent
- Sigvard AI launches automated LLM fine-tuning platform with GPU selection, seeks feedback — BeatedBull · 2026-11-17
- AI horror short 'The Day She Arrived' built with Midjourney, Hailuo H3 and ElevenLabs — Kyrannio · 2026-11-17
- Developer ships ASC CLI 7.0.0 ahead of schedule — rudrank · 2026-11-17
- MCP directory self-audit: 704 of 711 'serious' security findings were false positives — Glittering_Device653 · 2026-11-17
- Grok Bot Content System: Automate Research, Never Judgment — a $10K Side-Biz Play — PrajwalTomar_ · 2026-11-17
- Qwen Code Desktop v0.28.0 ships DingTalk managed-agent adapter and workspace sidebar filter — github-actions[bot] · 2026-11-17