Automated versioning and evaluation of machine learning workflows

An application such as a machine learning workflow manager executes a machine learning workflow utilizing varying sets of parameters and tracks the utilized parameters and performance metrics for each execution. The manager generates a unique experiment identifier (ID) for each set of parameters use...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jain, Kapil, Badhwar, Shruti, Shahid, Faiyadh, Javeri, Nikhil Ratnesh
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:An application such as a machine learning workflow manager executes a machine learning workflow utilizing varying sets of parameters and tracks the utilized parameters and performance metrics for each execution. The manager generates a unique experiment identifier (ID) for each set of parameters used for executing a workflow and stores the experiment ID and the set of parameters along with results of the execution, e.g., performance metrics, output data, program code, etc. In some implementations, the manager can algorithmically generate sets of parameters for experiments of the workflow. Once experimentation for the workflow is complete, the manager utilizes the stored performance metrics to identify an experiment which exhibited the best performance and can retrieve the set of parameters, output data, or generated program code for deployment of the workflow using the associated experiment ID.