Action detection method and device, storage medium and electronic equipment

The invention discloses an action detection method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a target image sequence and target text information; inputting the target image sequence and the target text information into a pre-trained ta...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LIU ZHONGGENG, PAN HUADONG, PAN GUOXIONG, ZHENG JIA
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an action detection method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a target image sequence and target text information; inputting the target image sequence and the target text information into a pre-trained target detection model to obtain a target detection result, the target detection result including a target detection frame, a target action category and a target confidence, the target detection model is used for performing fusion processing on the target image sequence and the target text information through a cross attention mechanism to obtain a target fusion feature, and performing fusion processing on the target fusion feature, the target image sequence and the target text information through the cross attention mechanism to obtain a target multi-modal feature; and determining a target detection frame, a target action category and a target confidence coefficient according to the target multi-modal feature. The t