Diffusion images lack controllability: researchers argue for painter-style, tool-call-based generation

josephdviviano · x · 2026-11-17

A technical exchange on image-generation paradigms. @LinusMixson argues diffusion's core weakness is controllability: incorporating feedback is extremely hard, and OpenAI's Byzantine gpt-image-2 pipeline — likely compositing multiple diffusion outputs via tool calls — has remained SOTA for months. He sees more promise in code-based ("Claude paints in code") autoregressive approaches enabling painter-style in-stream composition. josephdviviano agrees, proposing diffusion be treated like a tool call doing many small transformations rather than a one-shot generator.

Original post →

More from Models

Models channel →