Right-Click Anything: SAM 3.1, Muse Spark and Muse Image combined into one clever demo
nikhilaravi · x · 2026-09-22
A developer built a "Right-Click Anything" demo chaining three models now on Meta's Model API:
- Muse Spark captions the scene and extracts noun-phrases
- Those phrases prompt SAM 3.1 to predict instance masks for every object, so you can right-click any object like text on a web page
- "Look Up" hits Muse Spark web search for real product listings
- "Copy" returns an alpha-matted transparent PNG
- "Remove" paints the SAM 3.1 mask into the image and has Muse Image inpaint the object away
The author notes SAM 3.1 also supports video, leaving plenty of room for more combinations.
Related event: Developer Combines SAM 3.1 and Muse for Right-Click Anything Demo(2 posts)→
More from Multimodal
- Endless screensaver of self-assembling quantum cryostats, made with Gemini 4 Carbon — hapticdata · 2026-11-12
- ADM 3 Cloud ranks #47 of 80 at photo enhancement and restoration — ArtificialAnlys · 2026-11-12
- Apple's ADM 3 Cloud tested: #42 at image editing, #85 at text-to-image — ArtificialAnlys · 2026-11-12
- Object-level edits are ADM 3 Cloud's strongest skill, ranking #27 of 80 — ArtificialAnlys · 2026-11-12
- Apple's ADM 3 Cloud image model ranks #42 in editing and #85 in text-to-image on Artificial Analysis arena — ArtificialAnlys · 2026-11-12
- Adobe Firefly debuts Story Builder tool for streamlined visual storytelling — LudovicCreator · 2026-11-12