LFM3-Omni-2B runs fully offline on iPhone at ~80 tok/s via custom WebGPU kernels

xenovatech · reddit · 2026-11-05

A developer demonstrates LFM3-Omni-2B running fully offline on an iPhone 18 Pro Max at 80 tokens/s, powered by custom WebGPU kernels inside a React Native app — shown in airplane mode with a real-time camera understanding demo, a concrete proof of on-device inference on phones.

Related event: LFM3-Omni-2B Runs Fully Offline on iPhone at 80 tok/s(2 posts)→

Original post →

More from Infra

Infra channel →