Fudan's IDSpect Decomposes Chinese Characters into Radicals for Fine-Grained Text-to-Image RL Rewards
Fudan-University · hf · 2026-10-01
- Rendering accurate Chinese text remains hard: OCR-based RL rewards treat each character atomically, so visually different radical-level errors get equally coarse feedback, rewarding glyphs that merely resemble targets.
- Fudan's IDSpect uses Ideographic Description Sequences (spatial operators + components): a trained IDS recognizer transcribes rendered text into IDS tokens, and rewards align crop-level visual IDS predictions with a deterministically decomposed target sequence, plus a whole-character semantic reward.
- It requires no generator changes and adds no inference cost. Applied to GRPO post-training of Qwen-Image, IDSpect achieves leading structural quality and semantic alignment on LongText and GenTextEval.
More from Multimodal
- Testing Qwen Image 2.1 and Minimax H3 on anime-to-photo conversion and film photo restoration — Ant_6431 · 2026-11-16
- Second take of a 'Cubee run' video generated with Minimax H3 — JahJedi · 2026-11-16
- Non-artist builds 14-chapter hand-painted storybook game with Fable 5.2 in 4 hours — jradoff · 2026-11-16
- Subject LoRAs on Minimax H3 Image learn poor likenesses while identical datasets excel on Qwen 2.1 — Ad_Organic · 2026-11-16
- Seedance-generated anime train scene stuns Reddit with cinematic quality — Ok-Solution-7889 · 2026-11-16
- AI-generated 'Men in Black' reimagined in 1977 goes viral — techhalla · 2026-11-16