Researchers pool 258 experiments from 100 papers into a cognitive benchmark for LLMs
xuanalogue · x · 2026-10-01
The paper thread explains that the authors sourced 258 experiments from 100 papers across 30+ research labs, covering theory of mind, causal and physical reasoning, moral judgment, language, and pragmatics — forming a benchmark to measure how cognitively aligned large models are with humans. As the companion post notes, they then evaluated 50 language and multimodal models with R² and distributional divergence measures, finding a cognitive alignment gap between frontier models and humans.
More from AGI Musings
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16