Real-Time On-Device Vision AI on iPhone
amos_gyamfi · x · 2026-07-15
The author experimented with a SwiftUI real-time vision app locally on an iPhone, featuring four core capabilities:
- Classify: Real-time image classification using user-selected vision models, with options for PVT v2 (ImageNet-1k) or CLIP (zero-shot).
- Detect: Object detection with bounding boxes using RF-DETR.
- Segment: Instance/semantic segmentation via text prompts using SAM 3.
- Ask: Text or voice Q&A about the scene, combining Foundation Models and SpeechAnalyzer.
The key highlight is that these capabilities run entirely locally on the iPhone, demonstrating how Apple's on-device AI stack can be implemented in real-time vision applications.
Related event: Developer Showcases On-Device Real-Time Vision AI on iPhone(2 posts)→
More from Apps
- Strangeworks launches Aura to turn enterprise ops into production optimization systems — whurley · 2026-07-22
- OpenAI rolls out voice in GPT-Live, but the UI obscures search and reasoning — Graham_dePenros · 2026-07-22
- Meta AI adds interleaved image-and-text input to its text box — ezyang · 2026-07-22
- Rendergeist Pulse adds text overlays, saved presets and higher-quality exports — bennash · 2026-07-22
- EmblemVault adds limits, stops and multi-entry via DefinitiveFi Flash on Solana and EVM — adamamcbride · 2026-07-22
- A Reddit demo argues online stores should expose carts and pricing through MCP — gelembjuk · 2026-07-22