First 'multifunctional' brain implant uses AI to decode speech and gestures in real time
melnykowycz · x · 2026-09-15
Nature reports on a brain implant described in Nature Neuroscience that is the first to translate both verbal and non-verbal communication simultaneously. AI converts brain activity into on-screen text within seconds of intent and drives a personalized animated avatar performing gestures like nodding and pointing.
Unlike prior BCIs that restore one function at a time (speech, cursor, or robotic arm control), this device lets people with severe paralysis convey words and body language together, enabling more natural real-time communication.
Related event: First Brain-Computer Interface Decodes Speech and Gestures Together(2 posts)→
More from Research
- Burkov on LLMs' architecture-agnostic low-rank structure over long token sequences — burkov · 2026-11-02
- Adobe & UCLA's Tev: verifiable progress rewards lift long-horizon agent Pass@5 from 0.17 to 0.28 — jiqizhixin · 2026-11-02
- Old trick still works: portal sampling cuts path-tracing noise dramatically at 64spp — ssh4net · 2026-11-02
- Marcel Böhme's paper asks why cybersecurity can never be solved, proposes vulnerability-guided hardening — mboehme_ · 2026-11-02
- Perplexity open-sources WANDR: 500 research tasks, 170,495 evidence points, URL-rechecking grader — thisguyknowsai · 2026-11-02
- AI researcher: we have no reliable way to tell whether an AI system is conscious — dioscuri · 2026-11-02