Imperial lab prototypes latent tokenization and learnable adaptive-size memory
PontiEdoardo · x · 2026-09-11
Edoardo Ponti elaborates on his lab's research: they have prototyped latent tokenization in decoders and learnable, adaptive-size memory. Next steps are scaling these methods up and improving them, while exploring applications to inference-time hyper-scaling and long-horizon world modeling. The post is part of his AToM project recruiting thread; prototypes exist as Qwen3-8B-DMS-8x and Bolmo-7B.
More from Research
- Synthetic Morphology Suggests Non-Physicalist Models of Mind Can Be Empirically Tested — ZeroStateReflex · 2026-09-12
- Apple's Internalized Visual Thinking Drops the Paint-the-Future Pipeline for ~5x Faster Video Reasoning — jiqizhixin · 2026-09-12
- Skild AI founder explains why robotics data needs four sources, each flawed — deepakpathak · 2026-09-12
- Sony CSL's Frank Nielsen releases guaranteed arbitrary-precision approximations of Fisher-Rao geodesic distance — FrnkNlsn · 2026-09-12
- LittleLearner: a 5B model trained from scratch on a K-5-only corpus tests education data limits — repligate · 2026-09-12
- Conjectures launches Bittensor bounties paying TAO for cracking math problems open 30-80 years, judged by machine — markjeffrey · 2026-09-12