Ocean cross-modal image-text retrieval method, system and equipment and storage medium

The invention discloses an ocean cross-modal image-text retrieval method, system and device and a storage medium, and the method comprises the steps: carrying out the similar clustering of image global features and text global features through a global similarity measurement module, and extracting t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XIONG SHENGWU, HUANG JIRUI, GONG TENGFEI, YUAN JINGLING, CHEN YAXIONG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an ocean cross-modal image-text retrieval method, system and device and a storage medium, and the method comprises the steps: carrying out the similar clustering of image global features and text global features through a global similarity measurement module, and extracting the reconstructed image global features of an image and the reconstructed text global features of a text; the image local features, the text local features, the reconstructed image global features and the reconstructed text global features are fused and reconstructed through a multi-layer guidance module, so that the image local features of the image and the text local features of the text can be processed in a targeted manner, and the image local features and the text local features can be organically fused; and then fusion reconstruction is carried out on the reconstructed image global features and the reconstructed text global features, so that the aligned image features and the aligned text features with multi-m