Engineer uses Claude Code to build tiny CPU neural nets hitting ~6k tok/s per core
GregoryDiamos · x · 2026-09-07
Engineer Gregory Diamos tasked Claude Code with exploring 'outrageously small neural nets' for CPU inference and got three interesting discoveries, reaching 6k tok/s per core. He cautions it's experimental—production use would need a multi-trillion-token foundation run plus fine-tuning, taking months on a 32-core CPU.
Related event: Developer Uses Claude Code to Build Tiny CPU Model Hitting 10k+ tok/s(4 posts)→
More from coding & agent
- Managing MCP tool permissions: an Agent Proxy for pre-authorization per tool — radim11 · 2026-09-07
- Agent memory is not the context layer, and 'enterprise agent memory' may be a fake category — femke_plantinga · 2026-09-07
- Dev ships two iOS apps and an Obsidian plugin in one go with Codex — vista8 · 2026-09-07
- Korea's top game studio opens its animation/sound assets: VARCO 3D MCP and VARCO Sound — arrakis_ai · 2026-09-07
- Qwen Code ships cua-driver v0.20.4 with signed macOS, Linux and Windows binaries — github-actions[bot] · 2026-09-07
- Spotify cut Claude Code token usage by 90% by routing big file reads to cheap models — aliscodes · 2026-09-07