Audio-visual forgery detection method and device
The invention provides an audio-visual forgery detection method and device. The method comprises the following steps: acquiring video data to be detected; wherein the to-be-tested video data comprises at least two video frames, and each video frame comprises at least one group of audio-visual pairs...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides an audio-visual forgery detection method and device. The method comprises the following steps: acquiring video data to be detected; wherein the to-be-tested video data comprises at least two video frames, and each video frame comprises at least one group of audio-visual pairs composed of face images and audio data; inputting each audio-visual pair into the trained double-flow network to obtain a counterfeit detection result of the to-be-detected video data; wherein the double-flow network comprises an image network branch, an audio network branch and a prediction network; the image network branch is used for extracting face key point features of the face image and extracting inter-frame consistency features of the face image based on the face key point features; the audio network branch is used for extracting audio features of the audio data and extracting time consistency features of the audio data based on the audio features; and the prediction network obtains a forgery detection resu |
---|