Arena details post-training T2I models with 5M preference votes and VLM-built rubric rewards
arena · x · 2026-10-02
Arena's new blog explains its text-to-image post-training approach: a reward model trained on 5M pairwise human preference votes, plus rubrics auto-constructed by VLMs that check prompt-following, constraints, and known reward-hacking behaviors. Preference alone is insufficient—images can look great while missing objects, adding unrequested content, or drifting in style.
Results: post-trained FLUX.2-dev climbs 69 points to #2 on Arena's live T2I leaderboard; post-trained Ideogram 4 scores 1224, surpassing all publicly listed open-source models. The post covers rubric reward construction, the full offline eval setup, and before/after visuals of caught reward-hacking failures.
Related event: Arena Combines Preference and Rubric Rewards to Post-Train FLUX.2-dev(3 posts)→
More from Multimodal
- One image, 5x price gap: Gemini 4 Neon costs $1.01 vs GPT-6.2 Sol at $0.19 — Angaisb_ · 2026-11-19
- Gemini 4 Neon (xhigh) demo: generating a clean Ana de Armas portrait as SVG — lyraxana · 2026-11-19
- First human-vs-AI pop star interview: Scobleizer talks to virtual singer NOVA — Scobleizer · 2026-11-19
- Infinidream 0.17.2 brings 1080p Electric Sheep and screen-as-installation modes — scott_draves · 2026-11-19
- Fitting 5 character LoRAs in one image: 4 methods tested, best hits 3/5 — PoleRacers · 2026-11-19
- AI-generated robot priest praying in a candlelit church goes viral on Reddit — MrWoohoo · 2026-11-19