Bonsai 1.7B solves physics problems at ~9.1 tok/s on a 12-watt Intel N97
keequalshalfmvsqrd · reddit · 2026-09-18
A user demonstrated the Bonsai 1.7B model solving simple physics problems on a 12-watt Intel N97 chip at about 9.1 tokens per second, showing small models are usable on GPU-less edge devices.
More from Infra
- TRL Adds Async GRPO with LoRA Weight Sync over HF Buckets, Cutting Training from 3.5h to 53min — _lewtun · 2026-09-18
- Payments firms race to own AI inference: Stripe taps OpenRouter, Ramp enters the chain — xkonjin · 2026-09-18
- Qdrant wraps 4+ hour Vector Space Stream on vector search — recording now live — qdrant_engine · 2026-09-18
- Investor: QNX's microkernel is an undervalued moat for the agentic AI era — pdamodaran · 2026-09-18
- Inception CEO Stefano Ermon argues diffusion will beat autoregressive models on inference efficiency — No Priors · 2026-09-18
- Inception CEO Stefano Ermon: Diffusion Beats Autoregressive LLMs on Inference — No Priors · 2026-09-18