Scalable data extraction from data stores

Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for op...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: GUPTA RAKESH, GILANI ALTAF A, OVANESYAN OLEG G, LA RUE DENISE A, BURROWS JOHN P, MECHELKE THOMAS A.J, SCHULER CHRISTOPH, WANG YILEI
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for optimization of memory utilization by batching result sets and data conversion. Each subsequent call retrieves a packet of data, picking up where the previous call left off without an overlap. Parameters are updated after each call based on extracted data, available memory, and the like.