Gemini 2.5 Flash-Lite undergoes first double-blind evaluation in secure enclave
iamtrask · x · 2026-08-28
AVERI, in collaboration with Google DeepMind, OpenMined, and MLCommons, announced the first-ever double-blind evaluation of a proprietary LLM. The test of Gemini 2.5 Flash-Lite used the AILuminate safety benchmark inside a secure enclave, utilizing hardware isolation to solve structural privacy issues in high-stakes model evaluations.
More from Models
- GLM-5.3 unprompted reasons about how its actions affect its future training, worries Apollo — MariusHobbhahn · 2026-10-15
- Gemini 4 argon vs Opus 5.5 hands-on: 3 min for $3 vs 25 min for $8 — zacharynado · 2026-10-15
- SentinelOne says OpenAI did 4-6 weeks of reverse-engineering in 8 hours — OpenAI · 2026-10-15
- Qwen3.8 27B scores 23.57% on word-based addition without reasoning, 167/169 with it — dl_weekly · 2026-10-15
- Hacker turns EmbeddingGemma 2 into 288x realtime STT and a fast TTS — kastnerkyle · 2026-10-15
- Claude Fable 5.5 reportedly in partners' hands, release eyed next week — lyraxana · 2026-10-15