Edge0 open-sources on-device framework running 35B models in 1-2.5GB of memory
FinanceYF5 · x · 2026-09-10
Edge0 is now open source, releasing its 8B and 35B models along with runtime and inference code. The headline result: a 35B language model runs fully on-device on an iPhone using only 1-2.5GB of peak memory — no cloud, no remote server, no desktop GPU.
The framework also enables fully on-device generation for games, 3D scenes, and web content. The team invites edge-AI developers to try it and give feedback.
More from Infra
- Meta signs deal for tens of millions of AWS Graviton cores to power agentic AI — bookwormengr · 2026-09-10
- Edge0 open-sources streaming MoE framework with 35B and 8B on-device models — EAccelerate_42 · 2026-09-10
- iPhone 18 Pro's variable aperture: Apple returns to physics after hitting compute wall — r0ck3t23 · 2026-09-10
- Flux 2 Klein image model now runs fully in the browser via WebGPU — radamar · 2026-09-10
- AI server rail maker King Slide's founder is now Taiwan's richest man at $17.8B, passing Amodei and Altman — rwang07 · 2026-09-10
- SF Compute says resale of idle capacity saves customers 25%, cutting $4.5/hr to $3.375/hr — mattshumer_ · 2026-09-10