Monitor and classify dough based on color image with deep learning

To address subjective, time-consuming, and labor-intensive manual methods for monitoring and classifying fermenting dough, an automated and non-destructive method is proposed. Deep learning model YOLOv8s and extracted features including dough surface area, contrast, and homogeneity from RGB color images were employed to monitor fermenting dough. The features were input to a stacked ensemble model (SEM) with base models SVM, AdaBoost, KNN, and RF, with AdaBoost as meta-learner to classify fermenting dough into under-fermented, fermented, and over-fermented. SEM demonstrated a high dough classification rate of 83%, with specific rates of 75% for under-fermented, 71% for fermented, and 90% for over-fermented dough. Results reviewed that combining dough surface area and texture features is effective for monitoring dough, and can be used in adjusting chamber conditions. Furthermore, SEM showed great ability in classifying fermenting dough. The proposed method offers a promising solution for improved bread quality and consistency in bread-making. •YOLOv8s is effective for monitoring fermenting dough.•Fast segment anything model improves oval-shaped dough surface area estimation.•Combined area and texture features enable robust dough monitoring and classification.•Stacked ensemble model is reliable for classifying fermenting dough into three states.•RGB imaging is suitable for monitoring and classification of fermenting dough.