First double-blind eval of proprietary model via secure enclave
Miles_Brundage · x · 2026-08-28
AVERI, Google DeepMind, OpenMined, and MLCommons achieved the first double-blind evaluation of a proprietary model (Gemini 2.5 Flash-Lite). Conducted inside a secure enclave, the process ensures the lab (GDM) cannot see eval prompts and the evaluator cannot see weights. Cryptographic attestation verifies the correct model and evals were used.
More from Safety
- AI blamed for exploiting privacy chain: Pirate Chain rolls back after Ironwood vulnerability — adamamcbride · 2026-10-15
- SK Hynix ties new US plant to looser chip equipment exports to China, sources say — pstAsiatech · 2026-10-15
- Fox-IT releases the Cobalt Strike Beacon Corpus for detection research — cyb3rops · 2026-10-15
- Bank of America puts 4,000 people on fixing vulnerabilities uncovered by AI models — The Decoder · 2026-10-15
- Inside SAIF: a16z's $25M bet on AI rewriting the economics of cyber defense for small towns — a16z · 2026-10-15
- a16z launches SAIF, a $25M nonprofit to bring AI cyber defense to 1,800 rural hospitals — a16z · 2026-10-15