Data pipeline architecture

A method and a system for managing data flows and data processing operations with respect to a platform are provided. The method includes: executing a first set of microservice applications for coordinating data flows with respect to a data repository; executing a second set of microservice applicat...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Pinheiro, Ralph Joseph, Ibikunle, Olutayo
Format:	Patent
Sprache:	eng
Schlagworte:	CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC COMMUNICATION TECHNIQUE ELECTRIC DIGITAL DATA PROCESSING ELECTRICITY PHYSICS TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Beschreibung
Zusammenfassung:	A method and a system for managing data flows and data processing operations with respect to a platform are provided. The method includes: executing a first set of microservice applications for coordinating data flows with respect to a data repository; executing a second set of microservice applications for coordinating data processing operations; and executing a third set of microservice applications for performing metadata processing that relates to the data flows and the data processing operations. The system provides an architecture that is designed for delivering information with speed, scale, and quality to diverse destinations and use cases and providing advanced data processing to support real-time streaming processes and aggregated batch processes.