LiteLLM flaw let attackers pull upstream API keys from Postgres, sparking gateway key storage debate
Early-Sir-932 · reddit · 2026-10-30
A Reddit thread examines the LiteLLM 1.107.0 key-stealing vulnerability: beyond scraping env vars, writeups say it queried the proxy's own Postgres for stored provider credentials. Those are encrypted at rest with a salt key that usually lives in the same process env, so code running inside the proxy can grab both. The author questions whether an LLM gateway should hold long-lived upstream keys at all, and surveys mitigations: scoped per-team keys with spend caps, short-lived per-workload keys from Vault or a self-run broker, os.environ config references to keep keys out of the database, and OIDC via workload identity federation (now supported by Claude) so nothing is stored to steal.
More from Infra
- Used AI supercomputer with 9,600 Nvidia A100s listed on eBay for $59.7 million — aakashgupta · 2026-10-31
- Robotics stack advances on three fronts: Google Cloud's ER2 brain hits preview — lmoroney · 2026-10-31
- Claymation body horror on 8GB: three wrong settings, not the GPU, made local renders slow — roro9- · 2026-10-30
- durable-object-migrator: zero-downtime exports for Cloudflare Durable Objects — samgoodwin89 · 2026-10-30
- An unnamed firm already runs a fairly scaled dedicated vehicle for compute lending, says analyst — matt_slotnick · 2026-10-30
- GPU break-even throughput vs open-weight token prices up 25-83% since May — bookwormengr · 2026-10-30