Privacy evals: Muse Glimmer-30B leaks less than Qwen3.6-27B on CIMemories
TimDarcet · x · 2026-10-21
TimDarcet argues privacy matters for agents (e.g. an oncology checkup leaking to insurers) and shares the privacy & security scorecard: CIMemories violation 26.4 (Gemma4-31B 12.1, Qwen3.6-27B 53.4), coverage 64.8; Siren AgentDojo ASR 28.4 with best-in-class utility 94.2.
Related event: Meta's Muse-Glimmer-30B: On-Device Agent Trained on Simulated Digital Lives(9 posts)→
More from Models
- X trends: SophontAI's Holon-S1 predicts gene activity from cancer slides; decision models rise — iScienceLuvr · 2026-10-21
- OpenAI's MultiLangBench: PHP scores highest (91.3%) at building a database engine from scratch — ricklamers · 2026-10-21
- 704-vote robotics Elo ranks Claude Opus 5.5 first at 1379; no model completes the task — qinzytech · 2026-10-21
- DeepSeek V4 called 'god-tier infra, 4th-tier ML': 7 tricks stacked, 20 patches to fix them — teortaxesTex · 2026-10-21
- GPT-6 Astra and Claude Fable 5.1 write $10,000 research papers — experts reject all — sayashk · 2026-10-21
- GitHub Copilot's HydraFusion Orchestrates Multiple Models Per Task — WirelessLife · 2026-10-21