SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos
In this paper, we introduce SLAM3R, a novel and effective monocular RGB SLAM system for real-time and high-quality dense 3D reconstruction. SLAM3R provides an end-to-end solution by seamlessly integrating local 3D reconstruction and global coordinate registration through feed-forward neural networks...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | In this paper, we introduce SLAM3R, a novel and effective monocular RGB SLAM
system for real-time and high-quality dense 3D reconstruction. SLAM3R provides
an end-to-end solution by seamlessly integrating local 3D reconstruction and
global coordinate registration through feed-forward neural networks. Given an
input video, the system first converts it into overlapping clips using a
sliding window mechanism. Unlike traditional pose optimization-based methods,
SLAM3R directly regresses 3D pointmaps from RGB images in each window and
progressively aligns and deforms these local pointmaps to create a globally
consistent scene reconstruction - all without explicitly solving any camera
parameters. Experiments across datasets consistently show that SLAM3R achieves
state-of-the-art reconstruction accuracy and completeness while maintaining
real-time performance at 20+ FPS. Code and weights at:
https://github.com/PKU-VCL-3DV/SLAM3R. |
---|---|
DOI: | 10.48550/arxiv.2412.09401 |