Turning mouse sketches into clean drawings via gestalt-like priors and staged interpretation

debreuil · x · 2026-10-25

debreuil demos a pipeline that converts mouse-tracked drawings into a Gojo-style 'pre-numeric' encoding, uses gestalt-like priors to build a conceptual representation, then 'hallucinates' a clean image from those evidence streams.

The screenshot walks through 7 stages of the same house doodle: fitting raw strokes (5 strokes, 118 samples, 2.80 RMS), carrying long lines and whole curves, reading supported walls/roofs/arches, balancing parts while retaining the drawing, merging nearby joints and trimming overshoots, reading complete arches and a supported side frame, and finally synthesizing the facade while preserving side-view depth (9.94 RMS) — with every intermediate step visible and toggleable.

Original post →

More from Multimodal

Multimodal channel →