Microsoft's MoGe-3 Sets New SOTA on Depth Estimation Benchmarks
NielsRogge · x · 2026-08-31
Microsoft released MoGe-3, the new state-of-the-art on multiple depth estimation benchmarks on Papers with Code, in the paper "MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement".
Key idea: current SOTA models decode 3D geometry in a 2D parameterization where feature interactions are governed by image-plane proximity rather than true 3D spatial relations, mixing features from geometrically distant surfaces and over-smoothing thin structures. MoGe-3 introduces Self-Guided Sparse 3D Refinement (SSR): it lifts the coarse point map from a foundation base model onto a sparse voxel shell and refines it with sparse convolutions that aggregate features by 3D spatial locality, avoiding feature mixing across depth discontinuities to produce high-fidelity, metric-scale point maps.
Experiments across diverse datasets show it significantly outperforms existing approaches in recovering fine 3D detail, both quantitatively and visually. Weights are open on Hugging Face (microsoft/moge), with model cards in progress.
More from Research
- AlphaEvolve sets new record for matrix multiplication exponent: omega to 2.371177 — 新智元 · 2026-09-01
- Building a long-term memory benchmark for agents: what to add? — True_Mongoose_7073 · 2026-09-01
- Building a high-recall, traceable "second brain" RAG system? — iMiguelmars · 2026-09-01
- Study reveals cross-layer activation patterns in hybrid attention models — 机器之心 · 2026-09-01
- Group-averaged Markov chains papers updated, blending group theory with Markov chains — michaelchchoi · 2026-09-01
- The agent doom loop isn't the model being dumb — it's the transcript working against you — RunAI_Coder · 2026-09-01