Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video

Synthesizing realistic videos according to a given speech is still an open challenge. Previous works have been plagued by issues such as inaccurate lip shape generation and poor image quality. The key reason is that only motions and appearances on limited facial areas (e.g., lip area) are mainly dri...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2023-09
Hauptverfasser:	Wu, Xiuzhe, Hu, Pengfei, Wu, Yang, Lyu, Xiaoyang, Yan-Pei, Cao, Shan, Ying, Yang, Wenming, Sun, Zhongqian, Qi, Xiaojuan
Format:	Artikel
Sprache:	eng
Schlagworte:	Head movement Image processing Image quality Learning Mapping Speech Synchronism Synthesis Training Video
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!