Frontier Models Can Read Neural Network Weights and Figure Out the Net Plays Pac-Man
JnBrymn · x · 2026-11-04
An Arcturus Labs experiment shows frontier models can read, reason about, and even update neural network weights directly: given a 17,253-parameter network as plain tokenized text, Astra, Opus 5.5, and Muse Spark 1.3 all worked out the net plays Pac-Man — Astra with minimal reasoning.
The author argues this is counterintuitive: LLMs learn text and images, the weights are presented as plain text (token-sliced, not native numbers), and nobody writes essays explaining specific weights. Either labs deliberately trained this skill, or models generalize far further than expected — he leans toward the latter and finds it unsettling. The piece draws an analogy to having a complete fruit-fly connectome without brains being able to read other brains' wiring.
More from Models
- Leaked BenchCAD data shows OpenAI's internal model costs up to $37 per task, fueling $500 plan speculation — imjustnewatai · 2026-11-04
- 1,300+ graded word-association clues: Google models beat OpenAI's, both beat Anthropic's — Hardicecream17 · 2026-11-04
- Ex-OpenAI researcher Richard Ngo: alignment is the bottleneck to eliciting model capabilities — arthurcolle · 2026-11-04
- BallotBench sim trading: Gemini goes degen, tops leaderboard at $67 — mariofilhoml · 2026-11-04
- Claude Opus 5.5 hits 31.7T weekly tokens and $13M weekly spend, biggest launch yet — scaling01 · 2026-11-04
- Liquid AI launches d1-ultra, tied with SubQ Snap 1.1 and Elephant 9B at 65 on AA index — JosephJacks_ · 2026-11-04