Open-source Jev model runs offline on Mac M4 via CoreML at 45 decisions/sec
putna · hn · 2026-09-20
A Hacker News-shared gist demonstrates the open-source Jev model running fully offline on a Mac M4 via Apple CoreML, achieving roughly 45 decisions per second — a showcase of real-time, on-device inference on consumer Apple silicon.
More from Infra
- Meta data center floods Louisiana school district with $50,000 teacher bonus checks — victor_explore · 2026-09-21
- Substrate bets the agent loop is the new scheduling loop with fast suspend/resume — rakyll · 2026-09-21
- Agent Substrate open-sourced: agent runtime with 10x container density, sub-500ms resume — rakyll · 2026-09-21
- Huawei's Guo Ping: data centers next need 'book nerds' to route tokens, not coders — teortaxesTex · 2026-09-21
- Chris Albon jokes he'll be 'post-economic' as local compute beats cloud models by 2027 — chrisalbon · 2026-09-21
- GPUs are the commodity; the AI software stack above them will decide the winners — ypatil125 · 2026-09-21