Multi-source heterogeneous data automatic fusion method, system and device and storage medium
The invention discloses a multi-source heterogeneous data automatic fusion method, system and device and a storage medium, belongs to the field of data fusion, and solves the problem of low data fusion development efficiency. Comprising the steps of obtaining a database operation statement of multi-...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a multi-source heterogeneous data automatic fusion method, system and device and a storage medium, belongs to the field of data fusion, and solves the problem of low data fusion development efficiency. Comprising the steps of obtaining a database operation statement of multi-source heterogeneous data, wherein the database operation statement carries information of a source database and a target database; based on database operation statements, generating a data automatic evaluation and screening model through a swarm intelligence optimization algorithm or a data standard screening algorithm preying by the migrant birds; analyzing the source data format of the database operation statement to obtain analyzed data, taking the analyzed data as the input of the data automatic evaluation and screening model to carry out data extraction and cleaning, removing dirty data in the analyzed data, and outputting fused data; importing the fused data into a target data channel; and generating increme |
---|