Lab2Sim benchmark: turning 218 real experiment videos into interactive virtual experiments
PolyUHK · hf · 2026-11-03
Researchers from South China University of Technology and PolyU introduce Lab2Sim, on converting real science experiment videos into interactive virtual experiments.
- Benchmark: 218 experiment videos with evidence-grounded specifications and 11,881 rubric items, evaluating functional correctness and interactive behavior of generated code; reconstruction must enforce the preconditions governing each operation, not just reproduce apparatus and state changes.
- Method (EduVideo2Code): encodes procedures as state machines to generate verified code for interface transitions — sidestepping the need to infer physical states of materials, one of the hardest parts of scientific video understanding.
- Encoding procedures as state machines improves apparatus fidelity.
More from Research
- ADAPT: Diffusion action priors enable robust text-driven humanoid whole-body control — breadli428 · 2026-11-03
- Harmonic's Aristotle formally verifies a floating-point SRT divider in 39 minutes, weeks of expert work — satnam6502 · 2026-11-03
- Harmonic to demo AI theorem prover 'Aristotle' for hallucination-free hardware synthesis at REACH 2026 — satnam6502 · 2026-11-03
- Zeroing one weight column in Qwen3.5-0.8B turns broken generated chair code into a correct chair — victormustar · 2026-11-03
- AlphaFold3 guided by NMR, X-ray and cryo-EM data resolves protein ensembles — mmbronstein · 2026-11-03
- Xiaomi open-sources Robotics-1, a robot foundation model trained on 100K hours of trajectories — CyberRobooo · 2026-11-03