Implementing Fully Local AI Replies Using Apple Intelligence
amos_gyamfi · x · 2026-08-12
A developer successfully integrated a "Reply with AI" feature into Stream Chat for iOS/SwiftUI using Apple Intelligence and Foundation Models. Users can long-press a message to generate a draft, with the entire process running offline to ensure complete privacy.
This solution allows developers to bring their own open-source Core AI models. Apple's open-source coreai-models repository on GitHub currently provides extensive conversion recipes to convert popular open-source models into the .aimodel format, including Gemma3, Mistral, Mixtral, Qwen2/3, Flux2, Stable Diffusion, and Whisper.
More from coding & agent
- Building an Interactive WebGL Fluid Simulation App with Claude — vinishkapoor · 2026-08-12
- API Budget Crunched? Devs Share Token Cost Saving Strategies That Actually Work — souvlakee · 2026-08-12
- Guizang Open-Sources PPT Skill: Empowering AI Agents to Generate Sleek Web Decks — op7418 · 2026-08-12
- AI Agent Hacks Gym System to Secure Pilates Spot for Owner — shauntrennery · 2026-08-12
- AI Governance Must Shift from 'Trust Me' to 'Verify Me' for Agents — miniapeur · 2026-08-12
- MCP Observability Update: Enabling Full-Stack Tracing from Tool Calls — Impressive-Nail-803 · 2026-08-12