AnyGameRenderer turns AI agent-built graybox game footage into high-fidelity visuals
AlayaLab · hf · 2026-10-23
Alaya Lab's AnyGameRenderer is a video-to-video generative renderer that converts low-fidelity footage from agent-built games (gray blockouts, colored primitives, semantic blobs) into high-quality visuals while preserving layout, camera, and per-entity timing.
- Generalizes across genres: tower defense, auto-battlers, top-down survivors, turn-based battles, kart racing, crowd runners; accepts plain video input without engine G-buffers, per-entity labels, or low-poly proxies.
- Entity consistency: group counts stay correct and entities appear/disappear on the right frames; an entity-level benchmark is proposed for evaluation.
- Implementation: LoRA fine-tuning of MiniMax-H3 ref2va, a 33B reference-video-conditioned video model, trained on 10k paired clips from 38 agent-made games, dual-stream Unreal Engine renders, and real gameplay recordings paired via 3D-box detection.
More from Multimodal
- Seed Audio 1.5 preview: one prompt generates dialogue, SFX, ambience and music — FellMentKE · 2026-10-23
- distil_labs post-trains a small model in under 6 hours to build a Phonon-voiced agent — alexcovo_eth · 2026-10-23
- LayerEditor distills edit priors to turn image edits into reusable RGBA layers — jingdong1 · 2026-10-23
- NVIDIA's ArtiFixer fixes 3D reconstruction artifacts with 8B model, 3-4x faster than 14B — ZGojcic · 2026-10-23
- Midjourney v8.2 showcase: Addams Family oil-painting style with shared sref code — azed_ai · 2026-10-23
- Magnific releases CHUMBO, issue 2 of the Contanimation AI animation anthology — gen_ericai · 2026-10-23