Running 1.5B Voice Model Locally on iPhone: Only 2.2GB Memory

Acceptable-Cycle4645 · reddit · 2026-08-05

A developer successfully ran the VibeVoice 1.5B model locally on an iPhone. This edge deployment requires only about 2.2 GB of memory and achieves generation speeds up to 1.28x real-time. Tests showed stable VRAM usage during long-form generation, and the underlying code and xcframework will be open-sourced in the audio.cpp repository.

Related event: VibeVoice 1.5B Runs Locally on iPhone(2 posts)→

Original post →

More from Infra

Infra channel →