Molmo2Fish lets researchers fix salmon-tracking errors with natural language
allen_ai · x · 2026-10-14
In this thread follow-up, Ai2 frames the problem: fixing overcounts in salmon-tracking video usually means editing clips frame by frame. Molmo2Fish, a prototype built on open Molmo 2, can correct some tracking mistakes after natural-language guidance. See the main post's summary for full details.
Related event: MIT Researchers Build Molmo2Fish to Track Salmon in Sonar Video(4 posts)→
More from Research
- Spork post-training recipe lifts chess puzzle solve rate 100% over best GRPO setup — aidenybai · 2026-10-14
- Dyna-2 Deep Dive: World-Action Models Trained on 1M Hours of Human Video, 99.4% 24-Hour Autonomy — Latent Space · 2026-10-14
- Procedural Core: a 1M-param abstract model boosts 85M-param ViT ImageNet accuracy by 2.2 points — kastnerkyle · 2026-10-14
- Nature Will unveils Natura-1: 50B-parameter MoE robot foundation model trained on 1M hours of egocentric human video — rohanpaul_ai · 2026-10-14
- PR-OPD aligns hidden states for agentic RL, up to +14.0 WebShop accuracy over GRPO — Muyang Li · 2026-10-14
- Do reasoning traces actually matter? A three-stage causal study on distilled DeepSeek R1 models — burkov · 2026-10-14