Researchers wonder: is OpenAI using its strongest models to search for a post-Transformer architecture?
SonglinYang4 · x · 2026-11-02
Wait—summaryen needed. Rewriting: User Chonghan Liu observed that OpenAI seems obsessed with math, pouring GPUs into extremely hard math problems, and asked whether OpenAI has ever used its strongest models to search for a better architecture than the Transformer. Songlin Yang reposted saying he's curious too.
It touches on a popular industry question: beyond scaling current architectures, could models help design their own successors? No public evidence suggests OpenAI is doing this.
More from AGI Musings
- The 'thesaurus on steroids': an underexplored interaction pattern for generative models — chrissyykat · 2026-11-02
- rauchg: Own Your Intelligence — Embrace Open Source and Local Models — mitsuhiko · 2026-11-02
- rakyll: No Moat Up, Down, or in the Middle of the AI Stack — rakyll · 2026-11-02
- Engineer onboards ad director and surgeon onto Codex — their use cases surprise even her — enggirlfriend · 2026-11-02
- German flagship daily's AI coverage slammed: labs 'anti-democratic,' Meta a thief — kimmonismus · 2026-11-02
- Making 1-hour intuitive explainer videos with AI is now a superpower, says founder — gabriel1 · 2026-11-02