Dual-engine-driven multi-modal data retrieval method, device and system

The invention discloses a dual-engine-driven multi-modal data retrieval method, device and system, and belongs to the field of multi-modal data comprehensive retrieval, and the method comprises the following steps: S1, taking multi-modal data as input, judging semantic tags of the multi-modal data,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CUI YING, PAN LEI, LIAO HONGZHOU, DAI XIANG, DAI LICAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a dual-engine-driven multi-modal data retrieval method, device and system, and belongs to the field of multi-modal data comprehensive retrieval, and the method comprises the following steps: S1, taking multi-modal data as input, judging semantic tags of the multi-modal data, and constructing a semantic tag library; constructing a unified feature space, extracting feature vectors of different modal data in the same feature space, and constructing a feature vector library; s2, taking a multi-modal retrieval condition as input, respectively obtaining a semantic tag and a feature vector of the retrieval condition through a multi-modal data intelligent processing method, and obtaining a semantic tag library and a feature vector library based on the semantic tag library and the feature vector library; a cross-modal semantic tag retrieval engine and a cross-modal feature vector retrieval engine are used for completing query of multi-modal data meeting retrieval conditions in a multi-modal dat