Data warehouse-based data development method and system
The invention discloses a data warehouse-based data development method and system. The method comprises the following steps of S1, loading metadata into hive; S2, performing data development on hive;and S3, synchronizing a result table of data development in the step S2 to the target database. Accor...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a data warehouse-based data development method and system. The method comprises the following steps of S1, loading metadata into hive; S2, performing data development on hive;and S3, synchronizing a result table of data development in the step S2 to the target database. According to the scheme, the metadata is loaded into the hive; data development is carried out on hive through the existing python, SQL and other technologies. The technologies such as python, SQL and the like are relatively existing technologies; therefore, technicians can configure and adjust the datadevelopment process according to the actual situation of the project, most of the components needing to be used are supported by the open source community for free, the version of each component canbe upgraded more conveniently, and better performance and function improvement are achieved. The problem that an existing database development platform is poor in expansibility and adaptability is solved.
本发明公开了一种基于数据仓库的数据开发方法及 |
---|