ETL data processing system and method combined with Dubbo service

The invention provides an ETL data processing system and method combined with Dubbo service. The system comprises an ETL data extraction module, a first ETL data cleaning and conversion module, a Dubbo service module, a second ETL data cleaning and conversion module and a data loading module. The ET...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG LIANG, LI XIANFENG, XIONG CHUN, ZHANG XIONGBIAO, ZHANG YONGQIANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides an ETL data processing system and method combined with Dubbo service. The system comprises an ETL data extraction module, a first ETL data cleaning and conversion module, a Dubbo service module, a second ETL data cleaning and conversion module and a data loading module. The ETL data extraction module is used for performing data extraction on the data; the first ETL data cleaning conversion module is used for performing data cleaning conversion processing on the extracted data; the Dubbo service module is used for calling a corresponding Dubbo service object according to a business demand, processing the data, and storing the processed data in a target database or inputting the data into the second ETL data cleaning and conversion module according to the business demand; the second ETL data cleaning conversion module is used for performing data cleaning conversion processing on the data; the data loading module is used for loading the processed data into a target database; according to t