Action detection method and device, storage medium and electronic equipment
The invention discloses an action detection method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a target image sequence and target text information; inputting the target image sequence and the target text information into a pre-trained ta...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses an action detection method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a target image sequence and target text information; inputting the target image sequence and the target text information into a pre-trained target detection model to obtain a target detection result, the target detection result including a target detection frame, a target action category and a target confidence, the target detection model is used for performing fusion processing on the target image sequence and the target text information through a cross attention mechanism to obtain a target fusion feature, and performing fusion processing on the target fusion feature, the target image sequence and the target text information through the cross attention mechanism to obtain a target multi-modal feature; and determining a target detection frame, a target action category and a target confidence coefficient according to the target multi-modal feature. The t |
---|