LongBanana: An Expert-Verified Benchmark for Long-Context Multi-Reference Image Synthesis

Kwai-Kolors · hf · 2026-11-09

Kwai-Kolors and academic collaborators introduce LongBanana, claimed to be the first expert-designed and verified benchmark for long-context multi-reference image synthesis in the agent-driven era. Tasks require retrieving dispersed visual evidence, rejecting distractors, binding entities and relations, and composing one coherent image from 32 references each. It contains 90 tasks in a 3×3 taxonomy with 4,670 expert-specified atomic evaluation items; a 15% double-labeled subset shows 89.4% exact agreement and 0.83 quadratic weighted kappa. Experiments show minimal agent harnesses beat direct generation, with a ReAct-Plan-Exec-Reflect workflow yielding further gains. Code and data are open.

Original post →

More from Multimodal

Multimodal channel →