vLLM Semantic Router flaw: duplicate filter name let one header bypass the security policy
colinmcnamara · x · 2026-11-20
Colin McNamara's AIMUG talk and long-form writeup "Black October" detail a security policy bypass in vLLM Semantic Router's Istio integration: two filters shared the same name, so a single routing header let requests skip the policy guard entirely — blocked requests returned 200 with no trace in the guard's logs. Finding the bug took a day, the fix (a rename) took an hour, but coordinating disclosure and reaching other projects running the same pattern took two weeks; the advisory went public six days after his report. The piece also critically examines the viral "Black October" cybersecurity panic narrative, noting several incidents had run for months and stemmed from old-fashioned failures like leaked keys and exposed credentials. Anyone on Istio 1.27+ with InferencePool routes and third-party extproc filters should check their setup.
More from Infra
- Investor warns surging AI receivables signal 2008-style leverage, not 1999 — MartinGTobias · 2026-11-20
- The 'Costco for Compute' launches: 30+ GPU types from $0.20/h to undercut big cloud's 5x markup — ycombinator · 2026-11-20
- Anthropic needs ~$602B annual revenue to earn 20% on its ~$1T compute commitments — basedjensen · 2026-11-20
- AMD crashes 13% in 30 minutes after short seller alleges illegal China chip sales — econoar · 2026-11-19
- Anthropic CEO Dario Amodei: hard to predict our compute needs — 'it's a lot' — BenBajarin · 2026-11-19
- What Sneakily Spiked Your LLM Bill? Cache-Killing Prompts and Billed Retries — Junior-Guitar-290 · 2026-11-19