Method for removing compression noise of video call video based on voice clue

The invention relates to a method for removing compression noise of video call videos based on voice clues. The method comprises the following steps: A, constructing a data set and preprocessing data;B, establishing a video compression noise removal model based on a voice clue: constructing a voice...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHAI XINLIANG, WANG DANFENG, REN JIACHANG, WEI WENHUI, LI YUJUN, BEN XIANYE
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a method for removing compression noise of video call videos based on voice clues. The method comprises the following steps: A, constructing a data set and preprocessing data;B, establishing a video compression noise removal model based on a voice clue: constructing a voice feature encoder model, a generative video compression noise removal model with the voice clue, an image authenticity discriminator and a video continuity discriminator; constructing an overall loss function to perform subsequent model optimization; C, training a video compression noise removal model based on a voice clue; and D, testing the denoising effect of the video compression noise removal model based on the voice clue, inputting the low-bit-rate and low-quality video call video and the corresponding voice signal into the model according to the trained denoising model, and outputting the high-quality video without the compression noise. According to the invention, the voice signal isused as an important clue