Chemical fiber industry data integrated processing method based on Presto

The invention relates to a big data integration method, in particular to a chemical fiber industry data integration processing method based on Presto. The method comprises the following steps: 1) performing similarity combination and classification modeling on data according to themes; 2) obtaining...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: YE XIAOQIAN, GAO JIANJIANG, WANG QIANG, YAN PEIZONG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a big data integration method, in particular to a chemical fiber industry data integration processing method based on Presto. The method comprises the following steps: 1) performing similarity combination and classification modeling on data according to themes; 2) obtaining business data and writing the business data into a data table; 3) data integration rule configuration; 4) storing the acquired data in different data tables according to a configured rule; 5) performing priority judgment on the data priority; 6) determining the priority of the data, and calculating a composite index; (7) statistical data are generated for the measurement data indexes, and a result set is stored in a data table; according to the method, the real-time performance of the data can be guaranteed, the uniformity of the system can be achieved, meanwhile, the compatibility of various kinds of data on the same platform is guaranteed, and good expandability is achieved. 本发明涉及大数据集成方法,尤其涉及一种基于Presto的化纤行业数据集成处理