Mengdi Wang unveils LabOS: an AI intelligence layer that watches and guides lab experiments

MengdiWang10 · x · 2026-10-28

Mengdi Wang's team introduced LabOS, a system that turns AI into a fundamental intelligence layer for scientific labs: an XR glasses app streams video, audio, and equipment feeds (4 frames/s in 5-second segments) to a VLM agent running on local GPU or cloud, which analyzes the experiment and gives real-time feedback.

Demos show it checking SOP compliance step-by-step during cell passaging — catching errors like skipping incubation after adding trypsin — and integrating cobots with RealSense perception for real-time object/action recognition and seamless human-robot handover.

Her thesis: AI will become as basic to labs as microscopes and computing infrastructure, making science itself a continuously learning system.

Original post →

More from Embodied

Embodied channel →