Depth Anything 3: Recovering the Visual Space from Any Views
Zhejiang University · ByteDance Inc · ByteDance · ByteDance Seed (Singapore) · King Abdullah University of Science and Technology · Bytedance Inc. · Bytedance Intelligent Creation · ByteDance Inc. · National University of Singapore
PDF 由论文原始站点提供,PaperCompass 不保存论文文件。
摘要
We present Depth Anything 3 (DA3), a model that predicts spatially consistent geometry from an arbitrary number of visual inputs, with or without known camera poses. In pursuit of minimal modeling, DA3 yields two key insights: a single plain transformer (e.g., vanilla DINOv2 encoder) is sufficient as a backbone without architectural specialization, and a singular depth-ray prediction target obviates the need for complex multi-task learning. Through our teacher-student training paradigm, the model achieves a level of detail and generalization on par with Depth Anything 2 (DA2). We establish a new visual geometry benchmark covering camera pose estimation, any-view geometry and visual rendering. On this benchmark, DA3 sets a new state-of-the-art across all tasks, surpassing prior SOTA VGGT by an average of 35.7\% in camera pose accuracy and 23.6\% in geometric accuracy. Moreover, it outperforms DA2 in monocular depth estimation. All models are trained exclusively on public academic datasets.