DISTRIBUTED PROCESSING NETWORK OPERATIONS

Generally discussed herein are systems, devices, and methods for data distribution in a distributed data processing system (DDPS). A device of a distributed data processing system may include a storage device to store data regarding data nodes (DNs), switches, and racks on which the DNs and at least...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gasparakis, Iosif, Mala, Praveen
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Generally discussed herein are systems, devices, and methods for data distribution in a distributed data processing system (DDPS). A device of a distributed data processing system may include a storage device to store data regarding data nodes (DNs), switches, and racks on which the DNs and at least some of the switches reside, and circuitry to receive, from a name node or a client node of the DDPS and coupled to the device, a first communication indicating one or more DNs to which a portion of a file is to be replicated, determine a component in a data path between the client node and one or more of the DNs at which to mirror the portion of the file, and provide a second communication indicating the component at which the data is to be mirrored, one or more of the DNs to receive the portion of the tile, and the corresponding one or more of the racks on which the DNs reside.