METHOD AND SYSTEM FOR MANAGING HYBRID SPARK CLUSTER FOR EFFICIENT SPARK JOB EXECUTION

METHOD AND SYSTEM FOR MANAGING HYBRID SPARK CLUSTER FOR EFFICIENT SPARK JOB EXECUTION

Disclosed are a method and system for managing a hybrid Spark cluster for efficient Spark job execution. A cluster management method which is performed by a cluster management system may include, in a hybrid Spark cluster environment including a bare-metal-based cluster and a Kubernetes-based cluste...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CHUN, Seung-Tae, KIL, Gi-Beom, CHOI, Gyu-Hong, LEE, Dong-Wook
Format: Patent
Sprache:eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Disclosed are a method and system for managing a hybrid Spark cluster for efficient Spark job execution. A cluster management method which is performed by a cluster management system may include, in a hybrid Spark cluster environment including a bare-metal-based cluster and a Kubernetes-based cluster, selecting a cluster manager comprising the bare-metal-based cluster or the Kubernetes-based cluster before a Spark client performs a Spark driver program, and performing a Spark job by using the selected cluster manager.