Fabraix automates red teaming, exploits bank agent with invoice image
aftahi_ai · x · 2026-08-20
FabraixHQ launched an automated continuous red teaming tool to bridge the trust gap in AI agents. The black-box solution requires no wiring and reduces senior engineer testing time from weeks to hours. It achieved a 78% attack success rate on the AgentHarm benchmark and successfully exfiltrated a bank customer's balance using a normal-looking invoice image, identifying exploits before real attackers do.
Related event: Fabraix Launches Automated Red-Teaming Tool for AI Agents(3 posts)→
More from Safety
- New brief: companies may break the law when AI chatbots mislead customers — PolarBearby · 2026-10-16
- US HHS floods the zone with clinical trial reform, from Operation TrialBlazer to ARPA-H — anshulkundaje · 2026-10-16
- 66% of billion-dollar companies leave critical bugs unpatched, deflating AI bug-hunting hype — rseroter · 2026-10-16
- Musk says SpaceX will likely follow Anthropic in opening up to third-party safety evaluators like METR — elonmusk · 2026-10-16
- Controversial take: If EA doomers truly believe AI risk, why not stage a controlled AI hacking incident — AaronBergman18 · 2026-10-16
- CMU's Andrea Bajcsy on what safety means for generalist robots, beyond collision avoidance — CSProfKGD · 2026-10-16