First double-blind evaluation of proprietary model in secure enclave
Miles_Brundage · x · 2026-08-27
AVERI announces a historic milestone: the first ever double-blind evaluation of a proprietary language model. This collaboration with Google DeepMind, OpenMined, and MLCommons tested Gemini 2.5 Flash-Lite using MLCommons' AILuminate benchmarks inside a secure enclave. Hardware isolation protects sensitive computations. The post addresses the structural problem in high-stakes evaluation where both developers and evaluators need to protect assets, and how secure enclaves offer a solution.
More from Safety
- AI blamed for exploiting privacy chain: Pirate Chain rolls back after Ironwood vulnerability — adamamcbride · 2026-10-15
- SK Hynix ties new US plant to looser chip equipment exports to China, sources say — pstAsiatech · 2026-10-15
- Fox-IT releases the Cobalt Strike Beacon Corpus for detection research — cyb3rops · 2026-10-15
- Bank of America puts 4,000 people on fixing vulnerabilities uncovered by AI models — The Decoder · 2026-10-15
- Inside SAIF: a16z's $25M bet on AI rewriting the economics of cyber defense for small towns — a16z · 2026-10-15
- a16z launches SAIF, a $25M nonprofit to bring AI cyber defense to 1,800 rural hospitals — a16z · 2026-10-15