RayDer (ECCV 2026) open-sourced: scalable self-supervised novel view synthesis from real-world video

rsasaki0109 · x · 2026-11-10

CompVis (LMU Munich, Björn Ommer's group) open-sourced RayDer, an ECCV 2026 paper with a minimal self-contained PyTorch re-implementation (training and video-generation scripts included).

RayDer removes the static-scene data bottleneck of self-supervised novel view synthesis by consolidating three networks into a single unified transformer, adding dynamic state prediction with dropout, and improving pose learning through autoregressive training. Performance follows power-law scaling (R² > 0.99) in data, model size and compute, analogous to LLMs. Zero-shot comparisons against E-RayZer across DTU, CO3D, Mip360, LLFF and near-zero-overlap extreme settings show consistent gains.

Related event: CompVis Open-Sources RayDer for Self-Supervised Novel View Synthesis(2 posts)→

Original post →

More from Research

Research channel →