Resource allocation for tuning hyperparameters of large-scale deep learning workloads

A method, computer system, and a computer program product may perform hyperparameter tuning. Hyperparameter search input data may be received. A search algorithm to generate a set of hyperparameters may be invoked. A hyperparameter tuning resource allocator may receive physical resource data regardi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Asis Kumar Patra, Saritha Vidod, Anto Ajay Raj John
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A method, computer system, and a computer program product may perform hyperparameter tuning. Hyperparameter search input data may be received. A search algorithm to generate a set of hyperparameters may be invoked. A hyperparameter tuning resource allocator may receive physical resource data regarding a cluster. The hyperparameter tuning resource allocator may determine a required workload and may use a received number of parallel experiments to determine the required workload. The hyperparameter tuning resource allocator may determine whether an option to mandate the workload batch size was selected. The cluster may perform the number of parallel experiments to search and tune the set of hyperparameters. The hyperparameter tuning resource allocator may manage the cluster according to the physical resource data and the required workload and by using tensor swapping.