Import AI 476: HSS visual reasoning benchmark, AI in space, and research taste doubling every 3 months
Import AI (Jack Clark) · rss · 2026-10-12
Jack Clark's latest Import AI covers three big items:
Humanity's Sixth Sense (HSS) benchmark: Built by Elorian and Scale AI with 522 questions over 288 images and 234 video clips (17.6 hours), testing intuitive visual reasoning in four categories. Humans score 93.1 pass@1; the best AI (GPT 6 Astra) only 53.6. Chinese open-weight models do worse: GLM-5.3-flash 26.8, Kimi K3 25.5. Top failure modes: missing a decisive detail (21%) and misidentifying objects (20%). Notably, frontier LLMs' decent performance counters the claim that visual reasoning requires explicit 2D/3D world models.
AI goes to space: An AI Frontiers piece on how AI could compound advantages in a 2030s space economy — autonomous spacecraft, orbital manufacturing, self-replicating probes, and domain denial — potentially enabling strategic dominance. Clark thinks autonomous machines will dominate chunks of solar system activity.
TasteVal benchmark: P-Zero Research measures models' experimental research taste against a 24-expert baseline from OpenAI/GDM/NVIDIA/MSR. Best model Opus 5.5 exceeds human baseline at a 2.30x compute multiplier at 1/30 the cost; frontier research taste has doubled every 3.0 months since December 2025. Clark now expects full RSI in 2027, earlier than his previous 2028 estimate.
More from AGI Musings
- OpenAI researcher: progress will soon be data-bottlenecked, not intelligence-bottlenecked — giffmana · 2026-10-13
- Researcher: Artificial Life will be a key research direction as agentic AI gains self-replication and open-endedness — burny_tech · 2026-10-13
- AI-generated ads quietly take over: half of served IG and YT ads now look AI-made — eptwts · 2026-10-13
- Daniel Jeffries: only ~2% can actually use AI agents, mass adoption is 10-20 years away — Dan_Jeffries1 · 2026-10-13
- From chatbots to agents to personal AI assistants: the endgame is here — koltregaskes · 2026-10-13
- AI content can be useful and still make the internet worse: no POV, no skin in the game — Certain-Walrus5060 · 2026-10-13