SYSTEMS AND METHODS FOR MACHINE LEARNING MODEL MANAGEMENT

In some aspects, the techniques described herein relate to a method including: providing, on a model serving platform, a plurality of production machine learning models and a plurality of shadow machine learning models; routing input data to the plurality of production machine learning models and to...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ROLLINS, John, THARPE, Roy, ARORA, Anupam, NELLURI, Venu, ARUMUGAM, Raj
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In some aspects, the techniques described herein relate to a method including: providing, on a model serving platform, a plurality of production machine learning models and a plurality of shadow machine learning models; routing input data to the plurality of production machine learning models and to the plurality of shadow machine learning models; receiving, at a model monitoring engine, production output data from a first production machine learning model of the plurality of production machine learning models; receiving, at the model monitoring engine, offline output data from a first shadow machine learning model of the plurality of shadow machine learning models; promoting the first shadow machine learning model to a production machine learning model based on the offline output data; and demoting the first production machine learning model based on the production output data.