Multi-modal emotion recognition method and device, electronic equipment and storage medium

The invention relates to a multi-modal emotion recognition method and device, electronic equipment and a storage medium. The multi-modal emotion recognition method comprises the following steps: acquiring an electroencephalogram signal, a face signal and a voice signal of a subject; respectively pre...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG ZHIHANG, WANG HENGCHANG, PAN JIAHUI, FANG WEIJIE
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a multi-modal emotion recognition method and device, electronic equipment and a storage medium. The multi-modal emotion recognition method comprises the following steps: acquiring an electroencephalogram signal, a face signal and a voice signal of a subject; respectively preprocessing the electroencephalogram signal, the face signal and the voice signal, and respectively inputting the electroencephalogram signal, the face signal and the voice signal into a trained electroencephalogram emotion recognition model, a face emotion recognition model and a voice emotion recognition model to obtain probabilities of the electroencephalogram signal, the face signal and the voice signal corresponding to each emotion; and performing weight assignment and weight fusion on the probability of the electroencephalogram signal corresponding to each emotion, the probability of the face signal corresponding to each emotion and the probability of the voice signal corresponding to each emotion by using an