METHODS, SYSTEMS, AND MEDIA FOR RELIGHTING IMAGES USING PREDICTED DEEP REFLECTANCE FIELDS

Methods, systems, and media for relighting images using predicted deep reflectance fields are provided. In some embodiments, the method comprises: identifying a group of training samples, wherein each training sample includes: (i) a group of one-light-at-a-time (OLAT) images that have each been capt...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: KOWDLE ADARSH PRAKASH MURTHY, HARVEY GEOFFREY DOUGLAS, DENNY PETER JOSEPH, IZADI SHAHRAM, DEBEVEC PAUL, VALENTIN JULIEN PASCAL CHRISTOPHE, RHEMANN CHRISTOPH, BOUAZIZ SOFIEN, FANELLO SEAN RYAN FRANCESCO, DOURGARIAN JASON ANGELO, TAYLOR JONATHAN, FYFFE GRAHAM, YU XUEMING, BUSCH JESSICA LYNN, PANDEY ROHIT KUMAR, HANE CHRISTIAN, MEKA ABHIMITRA, WHALEN MATTHEW, LINCOLN PETER CHRISTOPHER, TAGLIASACCHI ANDREA
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Methods, systems, and media for relighting images using predicted deep reflectance fields are provided. In some embodiments, the method comprises: identifying a group of training samples, wherein each training sample includes: (i) a group of one-light-at-a-time (OLAT) images that have each been captured when one light of a plurality of lights arranged on a lighting structure has been activated, (ii) a group of spherical color gradient images that have each been captured when the plurality of lights arranged on the lighting structure have been activated to each emit a particular color, and (iii) a lighting direction, wherein each image in the group of OLAT images and each of the spherical color gradient images are an image of a subject, and wherein the lighting direction indicates a relative orientation of a light to the subject; training a convolutional neural network using the group of training samples, wherein training the convolutional neural network comprises: for each training iteration in a series of tr