POCKET: Running 35-Billion-Parameter LLMs Natively on iPhone
pmttyji · reddit · 2026-07-28
FINAL-Bench has released the POCKET model collection, designed to run massive 35-billion-parameter LLMs directly on mobile and edge devices like the iPhone. The models are available on Hugging Face, and the author is actively seeking feedback from users who have tested them on local hardware.
More from Infra
- Moonshot open-sources MoonEP to cut MoE communication overhead at scale — teortaxesTex · 2026-07-28
- LangChain says open source is in its blood as it partners with NVIDIA — Hacubu · 2026-07-28
- Morgan Stanley maps the AI infrastructure stack and who gets paid at each layer — SumitGup · 2026-07-28
- Google Cloud adds spend caps and sandboxes for untrusted agent workloads in Cloud Run — steren · 2026-07-28
- A Fields Medalist joins OpenAI as $250B data-center financing and Kimi K3 land — Dapper-Tale-4021 · 2026-07-28
- Bloomberg map shows Nvidia at the center of circular AI financing — SumitGup · 2026-07-28