Multi-energy-variety data cleaning and collecting method

The invention provides a multi-energy-variety data cleaning and collecting method, and belongs to the technical field of data cleaning. The method comprises the following steps: acquiring multi-energy variety data; performing cleaning preprocessing on abnormal data in the multi-energy-variety data b...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: QIAN YONGAN, PAN QIAN, TANG ZHIBIAO, DENG BITAO, DENG JINGCHUAN, LI JIAN, GAO SIYUAN, DU XIAODAN, HUANG YUFEN, NIE TINGTING, HU MEIBIN, HOU YUMING, FENG HAIYUN, CHEN RIZHAO, ZHENG ZHEN, LU ZHICHENG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a multi-energy-variety data cleaning and collecting method, and belongs to the technical field of data cleaning. The method comprises the following steps: acquiring multi-energy variety data; performing cleaning preprocessing on abnormal data in the multi-energy-variety data based on a distributed platform data cleaning method; performing conversion through a data conversion rule based on a mapping relation to obtain to-be-processed data; carrying out integration fusion based on a distance category POI fusion algorithm to obtain fusion data; performing data reduction processing based on a nonlinear data dimension reduction algorithm to obtain dimension reduction data; and filtering the dimension reduction data by adopting a quality evaluation rule based on a prefabricated evaluation index to obtain target data corresponding to the multi-energy variety data. According to the data processing method and device, the data cleaning, transformation, fusion and reduction processing methods are