An online visual measurement method for workpiece dimension based on deep learning

•A vision-based fusion method is proposed for measurement of workpiece dimensions.•FCN deep leaning model is used to detect interference regions of workpiece images.•Interference regions are processed by the directional texture repair method.•A method based on HED deep leaning model for rough edge detection is proposed.•The measuring accuracy of the proposed method can reach 0.02 mm. Image preprocessing and edge detection are the two most critical steps when applying machine vision to measure workpiece dimension in industrial field. The surface of the workpiece is usually covered with interference regions, which makes edge detection difficult. Aiming at the problem, the Full Convolutional Network (FCN) model is used to detect interference regions of workpiece images, and then interference regions are processed by the directional texture repair method. To avoid the influence of workpiece surface texture after rough machining, a method based on Holistically-nested Edge Detection (HED) model for rough edge detection of workpiece images is proposed. The edge is obtained by HED, and then it is post-processed based on the non-maximum value suppression and double threshold segmentation methods in the Canny operator to obtain a refined edge image. In order to further improve the accuracy of the dimension measurement, sub-pixel level edge detection accuracy is achieved by cubic spline interpolation. Finally, the method is validated by a shaft workpiece. The measuring accuracy of the outer diameter of the workpiece can reach 0.02 mm, which can effectively meet the requirements of fast semi-finishing inspection. This research provides a common workpiece dimension measurement method in industrial field and methodological guidance for the application of deep learning in industrial inspection.