Scalable data extraction from data stores

Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for op...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: La Rue, Denise A, Gilani, Altaf A, Schuler, Christoph, Burrows, John P, Ovanesyan, Oleg G, Gupta, Rakesh, Mechelke, Thomas A. J, Wang, Yilei
Format: Patent
Sprache:eng
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for optimization of memory utilization by batching result sets and data conversion. Each subsequent call retrieves a packet of data, picking up where the previous call left off without an overlap. Parameters are updated after each call based on extracted data, available memory, and the like.