DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstruction
We propose a novel framework for scene decomposition and static background reconstruction from everyday videos. By integrating the trained motion masks and modeling the static scene as Gaussian splats with dynamics-aware optimization, our method achieves more accurate background reconstruction resul...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | We propose a novel framework for scene decomposition and static background
reconstruction from everyday videos. By integrating the trained motion masks
and modeling the static scene as Gaussian splats with dynamics-aware
optimization, our method achieves more accurate background reconstruction
results than previous works. Our proposed method is termed DAS3R, an
abbreviation for Dynamics-Aware Gaussian Splatting for Static Scene
Reconstruction. Compared to existing methods, DAS3R is more robust in complex
motion scenarios, capable of handling videos where dynamic objects occupy a
significant portion of the scene, and does not require camera pose inputs or
point cloud data from SLAM-based methods. We compared DAS3R against recent
distractor-free approaches on the DAVIS and Sintel datasets; DAS3R demonstrates
enhanced performance and robustness with a margin of more than 2 dB in PSNR.
The project's webpage can be accessed via \url{https://kai422.github.io/DAS3R/} |
---|---|
DOI: | 10.48550/arxiv.2412.19584 |