Report details first double-blind eval of LLM using secure enclaves
Miles_Brundage · x · 2026-08-27
AVERI released a pilot report detailing the world's first double-blind evaluation of a proprietary language model, Gemini 2.5 Flash-Lite, in collaboration with Google DeepMind, OpenMined, and MLCommons. The evaluation used a secure enclave and Trusted Execution Environment (TEE) to ensure model weights and test prompts remained hidden from each other, addressing benchmark contamination and structural issues in independent auditing.
More from Safety
- FDA pays small company to build a grading system for AI-written radiology reports — YvesMulkers · 2026-10-16
- OpenAI tells US judiciary there may be no reliable way to detect AI-generated images and videos — Polymarket · 2026-10-16
- Gartner: 75% of organizations have seen unauthorized use of AI coding assistants — moniquejmorrow · 2026-10-16
- [un]prompted conference to stage three AI security debates on vulns, defenses, jailbreaks — WeldPond · 2026-10-16
- User Questions AI Chat Logs Being Instantly Copied to Governments and Firms — Turn_Trout · 2026-10-16
- Alignment researcher Turn_Trout blasts AI assistants scraping private Signal chats without consent — Turn_Trout · 2026-10-16