Multi-source heterogeneous data automatic fusion method, system and device and storage medium

The invention discloses a multi-source heterogeneous data automatic fusion method, system and device and a storage medium, belongs to the field of data fusion, and solves the problem of low data fusion development efficiency. Comprising the steps of obtaining a database operation statement of multi-...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CHEN GUANG, LIU LEI, TANG XINYU, JIN YONGZHE, WANG MENG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a multi-source heterogeneous data automatic fusion method, system and device and a storage medium, belongs to the field of data fusion, and solves the problem of low data fusion development efficiency. Comprising the steps of obtaining a database operation statement of multi-source heterogeneous data, wherein the database operation statement carries information of a source database and a target database; based on database operation statements, generating a data automatic evaluation and screening model through a swarm intelligence optimization algorithm or a data standard screening algorithm preying by the migrant birds; analyzing the source data format of the database operation statement to obtain analyzed data, taking the analyzed data as the input of the data automatic evaluation and screening model to carry out data extraction and cleaning, removing dirty data in the analyzed data, and outputting fused data; importing the fused data into a target data channel; and generating increme