Bonsai 1.7B solves physics problems at ~9.1 tok/s on a 12-watt Intel N97
keequalshalfmvsqrd · reddit · 2026-09-18
A user demonstrated the Bonsai 1.7B model solving simple physics problems on a 12-watt Intel N97 chip at about 9.1 tokens per second, showing small models are usable on GPU-less edge devices.
More from Infra
- Fire at Taiwan Panasonic PCB materials plant may tighten CCL supply further — zephyr_z9 · 2026-11-04
- Same Claude model served by Bedrock one day and Anthropic the next, dev finds — georgos_pappas · 2026-11-04
- Self-improving software is inevitable: closing the agent-observability loop — bibryam · 2026-11-04
- Gigabyte's AI TOP motherboard packs 2TB RAM and 9 GPUs for home AI labs — vincent_koc · 2026-11-04
- Building a 7-GPU 132GB VRAM local inference rig: consolidate on EPYC or split across two systems? — infectiousstupidity · 2026-11-04
- imec neural probe integrates photonics directly into 130nm CMOS backend — jwt0625 · 2026-11-04