Cross-modal retrieval method and device, equipment and storage medium

The invention provides a cross-modal retrieval method and device, equipment and a storage medium, and the method comprises the steps: obtaining to-be-retrieved data, the to-be-retrieved data being a text or an image; the to-be-retrieved data is input into a trained neural network model to obtain a h...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHU JIE, ZHU GENGHUA, ZHEN SHUYONG, CHEN PEIYU, WANG SHUOFEI, HAN LEI, GUO XIAOXUAN, GAO SHANSHAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a cross-modal retrieval method and device, equipment and a storage medium, and the method comprises the steps: obtaining to-be-retrieved data, the to-be-retrieved data being a text or an image; the to-be-retrieved data is input into a trained neural network model to obtain a hash code of the to-be-retrieved data output by a neural network, the neural network model comprises a text network and an image network, the text network is used for extracting global features of a text and generating a corresponding hash code according to the global features of the text, and the image network is used for extracting the hash code of the to-be-retrieved data; the image network is used for extracting global features and local features of the image and generating corresponding hash codes according to the global features and the local features of the image; and performing cross-modal retrieval on the to-be-retrieved data in the to-be-retrieved data set based on the hash code of the to-be-retrieved data