Neural networks for inline segmentation of image data in punching processes

Punching is a process that is sensitive to a multitude of parameters. The estimation of part and punch quality is often based on expert knowledge and trial-and-error methods, mostly carried out as a separate offline process analysis. In a previous study, we developed an optical inline monitoring system with subsequent image processing which showed promising results in terms of capturing every manufactured part, but was limited by slow image processing. Here, we present a more efficient image processing technique based on neural networks. For our approach, we manually identify the burnish parts in images based on criteria established via an expert survey in order to generate a training dataset. We then employ a combination of region-based and boundary-based losses to optimize the neural network towards a segmentation of the burnish surface which allows for an accurate measurement of the burnish height. The hyperparameter optimization is based on custom evaluation metrics that reflect the requirements of the burnish surface identification problem as well. After comparing different neural network architectures, we focus on optimizing the backbone of the UNet++ structure for our task. The promising results demonstrate that neural networks are indeed capable of an inline segmentation that can be used for measuring the burnish surface of punching parts.