First 'multifunctional' brain implant uses AI to decode speech and gestures in real time
melnykowycz · x · 2026-09-15
Nature reports on a brain implant described in Nature Neuroscience that is the first to translate both verbal and non-verbal communication simultaneously. AI converts brain activity into on-screen text within seconds of intent and drives a personalized animated avatar performing gestures like nodding and pointing.
Unlike prior BCIs that restore one function at a time (speech, cursor, or robotic arm control), this device lets people with severe paralysis convey words and body language together, enabling more natural real-time communication.
Related event: First Brain-Computer Interface Decodes Speech and Gestures Together(2 posts)→
More from Research
- Old School RuneScape comes to PufferLib 5.0 as a reinforcement learning environment — neuroecology · 2026-09-15
- Riddles built backwards: Waterloo's 20K-question ORBIT dataset trains search agents — CShorten30 · 2026-09-15
- Diploid-aware genomic language model released: most models train on genomes that don't exist — OdedRechavi · 2026-09-15
- 96 tools only cost 9 points: agent failures trace to turn-3 error chains, not tool count — EastVersion1226 · 2026-09-15
- Sheaf cohomology explains when predictive coding networks stall, NeurIPS paper shows — burny_tech · 2026-09-15
- A 3-step learning path for tabular foundation models: book, code, TabArena — pandeyparul · 2026-09-15