Shielding removing method based on nerve radiation field

The invention discloses an occlusion removal method based on a neural radiation field, and the method can achieve the foreground removal of a scene level in a self-supervised manner through a multi-view photo shot by a single scene without the supervision of external knowledge. Meanwhile, camera par...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: TANG YUNKAI, WAN RENJIE, SHI BAIXIN, ZHU CHENGXUAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an occlusion removal method based on a neural radiation field, and the method can achieve the foreground removal of a scene level in a self-supervised manner through a multi-view photo shot by a single scene without the supervision of external knowledge. Meanwhile, camera parameters are jointly optimized through a cost body, scene reconstruction is carried out on a neural radiation field through a mask, the features of multiple view angles can be fused, the camera pose and scene reconstruction process is more stably and jointly optimized, and the whole scene is more accurately reconstructed; besides, a selective self-supervision mechanism is provided to detect an area with occlusion by taking the bidirectional depth information of the light obtained by rendering as a clue, so that a non-occlusion area is selectively supervised, and reconstruction of a background layer is guided. 本发明公开了一种基于神经辐射场的去除遮挡方法,通过单场景拍摄的多视角照片,不需要外界知识作为监督,可以自监督地完成场景层面的去除前景;同时通过代价体联合优化相机参数和用掩膜对神经辐射场的场景重建,可以融合多视角的特征