A 397-Billion Parameter AI Runs on iPhone: On-Device AI Breakthrough
DJTRENDSETTA · reddit · 2026-08-16
A video demonstrates a 397-billion-parameter AI model running offline on an iPhone, generating text. It breaks down the mixture-of-experts design (96% of parameters dormant), Apple's paper predicting this three years ago, and how flash-moe team's cache deletion sped things up by 38%, while noting limitations in speed, storage, and heat.
More from Embodied
- China's First Homegrown High-Res Retinal Visual BCI Restores Sight — Dr_Singularity · 2026-08-16
- Uber Driver Claims Tesla FSD Handles 95% of Driving, Safety Score Hits 98% — Polymarket · 2026-08-16
- Linux successfully ported to Daylight DC-1 AR glasses — eschadiol · 2026-08-16
- Figure Founder on Next-Gen AI Hardware and Models — adcock_brett · 2026-08-16
- Extropic Unveils New Progress in CMOS Scaling — beffjezos · 2026-08-16
- Proposal for autonomous-only highway lanes with 100MPH speed limits deemed more efficient than high-speed rail — dauber · 2026-08-16