Method for Retraining with Auto-Validation of Machine Learning Models

Aspects of the disclosure are directed to retraining an ensemble machine learning model. The ensemble model can include a base model and an overlay model. The base model can be trained on an older dataset, validated, and manually verified. The overlay model can be trained on a newer dataset and automatically validated. A combination of base model predictions and overlay model predictions, with bias towards the base model predictions, can form ensemble model predictions. A model weight for optimizing the ensemble model can determine the bias, as well as indicate that the overlay model contributes too much or too little to the ensemble model.