Google DeepMind's SL2T Translates Sign Language to Text On-Device

ocean_protocol · reddit · 2026-08-12

Google DeepMind has introduced the SL2T model, which directly converts sign language into text. Debuting on the Pixel 11, the feature is integrated into Gboard and Live Transcribe, allowing deaf and hard-of-hearing users to easily type, search, or interact with Gemini using sign language.

The on-device model tracks pose points across the face, hands, arms, and torso, sending only coordinates to the server so raw video never leaves the phone. It supports one-handed and left-handed signing and includes hallucination prevention to avoid misreading grip adjustments. Currently, it only supports ASL to English, with more languages and devices planned for the future.

Related event: DeepMind Launches SL2T Sign Language Model on Pixel 11(10 posts)→

Original post →

More from Multimodal

Multimodal channel →