OmniRay: single-image 3D reconstruction for any lens — fisheye to panorama — sets new SOTA

anand_bhattad · x · 2026-10-24

OmniRay (arXiv 2610.31645) introduces camera-agnostic monocular 3D reconstruction. Its Ray Module hierarchically composes a monotone radial base, a spherical-harmonic residual, and a free-form residual as successive rotations on the sphere, covering pinhole, GoPro, fisheye, catadioptric and panoramic cameras. From a single image, it predicts per-pixel ray direction and up-to-scale radial distance to recover a point cloud without camera intrinsics, establishing a new state of the art.

Related event: OmniRay: Camera-Agnostic Monocular 3D Reconstruction from a Single Image(4 posts)→

Original post →

More from Research

Research channel →