Scalable data extraction from data stores
Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for op...
Gespeichert in:
Hauptverfasser: | , , , , , , , |
---|---|
Format: | Patent |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Extraction of data employing a sequence of remote function calls in form of a synchronous multi-batch call chain is provided. Sequencing of calls is enabled by generating parameters associated with the extraction of a next batch of data. The parameterized, dynamic generation of queries allows for optimization of memory utilization by batching result sets and data conversion. Each subsequent call retrieves a packet of data, picking up where the previous call left off without an overlap. Parameters are updated after each call based on extracted data, available memory, and the like. |
---|