SINGLE IMAGE 3D PHOTOGRAPHY WITH SOFT-LAYERING AND DEPTH-AWARE INPAINTING

A computer-implemented method comprising: determining, for each respective pixel of a plurality of pixels of a depth image, a corresponding depth gradient associated with the respective pixel of the depth image, wherein the depth image corresponds to a monocular image having an initial viewpoint, an...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: JAMPANI, Varun, SALESIN, David, CHANG, Huiwen, SARGENT, Kyle, CURLESS, Brain, L, TUCKER, Richard, KRAININ, Michael, KAR, Abhishek, LIU, Ce, FRREEMAN, William, T, KAESER, Dominik
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A computer-implemented method comprising: determining, for each respective pixel of a plurality of pixels of a depth image, a corresponding depth gradient associated with the respective pixel of the depth image, wherein the depth image corresponds to a monocular image having an initial viewpoint, and wherein each respective pixel of the plurality of pixels of the depth image has a corresponding depth value, determining a foreground visibility map comprising, for each respective pixel of the plurality of pixels of the depth image, a visibility value that is inversely proportional to the corresponding depth gradient associated with the respective pixel of the depth image, generating (i) an inpainted image by inpainting portions of the monocular image based on a background disocclusion mask that indicates, for each respective pixel of the plurality of pixels of the depth image, a disocclusion likelihood that a corresponding pixel of the monocular image will be disoccluded by a change in the initial viewpoint and (ii) an inpainted depth image by inpainting portions of the depth image based on the background disocclusion mask, and generating a modified image having an adjusted viewpoint that is different from the initial viewpoint by combining visual information of the monocular image and the inpainted image in accordance with the depth image, the inpainted depth image, and the foreground visibility map.