Fast virtual viewpoint synthesis method and device based on feature texture grid and Hash coding

The invention discloses a rapid virtual viewpoint synthesis method and device based on a feature texture grid and Hash coding, and the method comprises the steps: carrying out the preprocessing of an input viewpoint image data set, and obtaining the internal and external parameters of a camera of an...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: HUO ZHIYONG, GUO QUAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a rapid virtual viewpoint synthesis method and device based on a feature texture grid and Hash coding, and the method comprises the steps: carrying out the preprocessing of an input viewpoint image data set, and obtaining the internal and external parameters of a camera of an input image; pre-defining a single-resolution characteristic grid, and calculating an intersection point of a camera ray and the grid; the space coordinates of the intersection points are coded through a Hash coding network; the encoded feature vectors are trained through three small multi-layer perceptron networks, a rendered viewpoint image is obtained through alpha synthesis, a loss function of the rendered image and a loss function of a real image are calculated, and the multi-layer perceptron networks are supervised and optimized; and extracting the trained small-sized multi-layer perceptron and the feature texture grid, baking a feature texture map, and rendering in real time. 一种基于特征纹理网格和哈希编码的快速虚拟视点合成方法及装置,对