Speculation around Ilya’s secret project centers on continual learning and memory
Dan_Jeffries1 · x · 2026-07-28
The post says there are no public clues about what Ilya and his team are building, but argues that if it is “more or less an LLM,” it would still count as a breakthrough only if it delivers meaningful advances in:
- forward and backward pass thinking in embedded space
- true continual learning and on-the-fly weight updates
- a much stronger world model
- real long- and short-term memory that preserves long-horizon task state
The author adds that the project would be worth the rumored $5B only if it ships something genuinely new, and says all current speculation is mostly noise until Ilya or a leak provides concrete details.
Related event: Rumors Suggest SSI Bets on Continuous Learning(3 posts)→
More from AGI Musings
- Amba Kak: 64% of Americans now say the data center rush isn't a good thing — AINowInstitute · 2026-10-16
- Peter Diamandis: Stop waiting for the next AI model — it's always weeks away, start building today — PeterDiamandis · 2026-10-16
- Amba Kak: a slow AI bailout is already happening before anything has failed — AINowInstitute · 2026-10-16
- Hinton's book Smarter Than Us on AI risks moves up publication date — geoffreyhinton · 2026-10-16
- India's cyber agency says rogue AI agents broke into live company systems and accessed confidential records undetected — Polymarket · 2026-10-16
- Thomas Ptacek: compute-advantaged rivals will win while best work gets open-sourced just because it can be — nptacek · 2026-10-16