Meta’s GRACE cuts generative ads decoder latency by 11×
_reachsumit · x · 2026-08-04
Meta presents GRACE, a serving system for generative ads retrieval designed for real-time production use.
The system adds decode-time eligibility filtering and kernel-level optimizations to cut decoder latency by 11×. The paper focuses on two production constraints: making generated ads respect targeting rules, and keeping latency and GPU cost low enough for high-volume, wide-beam decoding.
More from Companies & People
- OpenAI co-hosted GPT-6 hackathons in SF and NYC with Cerebral Valley — OpenAIDevs · 2026-09-23
- Meta's Alexandr Wang reveals muse has been in the works since at least Sept 2025 — adrianscottcom · 2026-09-23
- OpenAI shares GPT-6 hackathon tale: builder used real star maps with Astra to find way home — OpenAIDevs · 2026-09-23
- Instacart lands on Meta's Muse: say "Taco Tuesday" and get an auto-built grocery cart — alexandr_wang · 2026-09-23
- Databricks ships GPT-6 Sol/Luna and Claude Opus 5.5 with Unity Gateway model governance — matei_zaharia · 2026-09-23
- Fields Medalist Martin Hairer Explains Why AGMAI Is Truly Independent of OpenAI — AlexKontorovich · 2026-09-23