Extracting statistical method and system aiming at semi-structured big data
The invention relates to an extracting statistical method and system aiming at semi-structured big data, and belongs to the field of big data extracting statistics. The extracting statistical method and system solve the problem that the process of extraction and statistics of the semi-structured big...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to an extracting statistical method and system aiming at semi-structured big data, and belongs to the field of big data extracting statistics. The extracting statistical method and system solve the problem that the process of extraction and statistics of the semi-structured big data is tedious and easy to cause data redundancy. According to the extracting statistical method and system, by providing a client to let a user input operational statements of the extraction and statistics aiming at the semi-structured big data, the operation statements are synchronized to a parsing conversion module which parses the operation statements and converts parsing results into configuration rules; the client calls an application engine module to generate a job task according to the configuration rules, and submit the job task to a underlying framework; the underlying framework splits the job task into multiple subtasks, distributes the subtasks to a cluster for execution, and returns the resulting dat |
---|