New BDH Architecture Matches GPT-2 Scaling, Runs on Normal GPUs
Candid-Tackle-9061 · reddit · 2026-08-10
Pathway has proposed a post-Transformer architecture named BDH. According to their presented data, this architecture successfully matches GPT-2's scaling performance from 10M to 1B parameters trained from scratch, and it can run on normal GPUs.
More from Research
- Harvard and MIT Built an AI Simulation of 8.3B Virtual People — anselm · 2026-08-10
- Top Hugging Face Papers: Long-Horizon Agents & Self-Improving RL — _akhaliq · 2026-08-10
- EU Digital Services Act Adopts Precision and Recall for Content Moderation Metrics — robinomial · 2026-08-10
- Achieving 62.46% MNIST Accuracy with Just 984 Learnable Parameters — Tall_Abrocoma_3533 · 2026-08-10
- Deep Dive: Why AI Agents Are Hard to Reason About Using Human Worker Logic — curious_vii · 2026-08-10
- Beyond Turing: How to Scientifically Test LLM Intelligence — ArtificialOther · 2026-08-10