Training AI to Paint with Code via Reinforcement Learning
kastnerkyle · x · 2026-08-25
This project trains an LLM to generate images by writing p5.brush JavaScript code using reinforcement learning, making the output editable code rather than static pixels. The system runs a four-step loop: the model receives a prompt and generates a sketch, which is rendered via Puppeteer into a PNG. A judge model compares this against reference paintings to produce a reward signal for GRPO updates. The core challenge explored is defining reward functions for subjective aesthetic tasks.
Related event: RL-Trained Qwen Coding Model Paints Watercolors by Writing p5.js Code(11 posts)→
More from Multimodal
- Kling 4.0 pitches director-style AI video: choreographed action and world-building, not random clips — alex_verem · 2026-10-15
- Adding motion graphics with just a prompt: the Claude Motion x ElevenLabs MCP workflow — CurieuxExplorer · 2026-10-15
- Google turns dense academic PDFs into animated storybooks with Gemini, Nano Banana and Veo — CurieuxExplorer · 2026-10-15
- One product photo plus one Seedance 2.5 prompt yields a full 15-second commercial — CurieuxExplorer · 2026-10-15
- Black Forest Labs finally releases model weights for download — MaziyarPanahi · 2026-10-15
- Continuous bitstream diffusion enables multimodal co-generation without per-modality calibration — LucaAmb · 2026-10-15