35B ternary LLM runs on iPhone in ~4GB RAM: Millie beats Bonsai 27B, 60% faster
MannyKayy · x · 2026-09-19
LLMs For All launched Millie, an iPhone app running a 35B ternary LLM entirely offline in 4GB of RAM. It beats Bonsai 27B 1-bit on every benchmark tested, with 60% faster generation and lower memory use.
- No account, no server, fully offline — privacy-focused
- Flagship 35B model supports photo understanding and adjustable reasoning; a lighter Millie Flash model offers faster replies
- Flagship needs 8GB RAM (iPhone 15 Pro and up), Flash runs on 6GB devices; downloads are 2GB / 8.6GB
- Open weights and runtime, free on the App Store
More from Infra
- Malaysia poised to become a compute superpower with both US and Chinese chips by next year — basedjensen · 2026-11-04
- ByteDance details USDB storage system: 85.8% lower write latency for recommender sequences — _reachsumit · 2026-11-04
- Oracle cancels $7B chip leasing deal with Tencent, FT reports — SumitGup · 2026-11-04
- Inference engine shrunk to 1023 bytes, still runs SmolLM2-135M — cneuralnetwork · 2026-11-04
- Musk says space data centers are 'looking pretty appealing right now' — elonmusk · 2026-11-04
- Data centers are turning to old jet engines as the wait for power grows — IndependentCoast3974 · 2026-11-04