Ex-Googler speculates Apple could build a next-token predictor native to Apple Silicon
yaroslavvb · x · 2026-09-12
Yaroslav Bulatov speculates that Apple's future on-device AI may not even be a full LLM, but some kind of next-token prediction mechanism native to Apple Silicon. The exchange started from another user noting how interesting an LLM "optimized out of the box for Apple Silicon" would be. Pure speculation, no official information involved.
More from Infra
- Clover-35B-A3B Quantized to 29.4 GB Runs at ~42 tok/s on a 64 GB Mac — viveky259 · 2026-10-31
- Liquid Agent brings fully local LFM3 agent to Linux with one-command install — JosephJacks_ · 2026-10-31
- A fully local office AI stack: MiniCPM, Qwen3, LFM2.5 and Whisper — HowDevelop · 2026-10-31
- a16z: GPU rental prices up 106% in 3 months while token prices fall 58% — a16z · 2026-10-31
- vLLM nightly adds PLE disk offload, with a telling [Qwen4Exp] tag on the PR — rmhubbert · 2026-10-31
- Solo AI studio: per-minute GPU rentals rendered a 328-frame Blender shot for ~$1 — r0ck3t23 · 2026-10-31