Audio-visual forgery detection method and device

The invention provides an audio-visual forgery detection method and device. The method comprises the following steps: acquiring video data to be detected; wherein the to-be-tested video data comprises at least two video frames, and each video frame comprises at least one group of audio-visual pairs...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: DUAN JUNXIAN, LI JIA, HE RAN, LIU CHENYU, HUANG HUAIBO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides an audio-visual forgery detection method and device. The method comprises the following steps: acquiring video data to be detected; wherein the to-be-tested video data comprises at least two video frames, and each video frame comprises at least one group of audio-visual pairs composed of face images and audio data; inputting each audio-visual pair into the trained double-flow network to obtain a counterfeit detection result of the to-be-detected video data; wherein the double-flow network comprises an image network branch, an audio network branch and a prediction network; the image network branch is used for extracting face key point features of the face image and extracting inter-frame consistency features of the face image based on the face key point features; the audio network branch is used for extracting audio features of the audio data and extracting time consistency features of the audio data based on the audio features; and the prediction network obtains a forgery detection resu