An automated optical inspection (AOI) platform for three-dimensional (3D) defects detection on glass micro-optical components (GMOC)

With the widespread deployment of wavelength division multiplexing (WDM), optical transceivers increasingly use many glass micro-optical components (GMOC). Visual inspection of these GMOCs is a critical manufacturing step to ensure quality and reliability. However, manual inspection is often labor-intensive and time-consuming due to the transparent nature of glass components and the small, randomly located defects in three dimensions. Although automated optical inspection (AOI) exists, it has not yet been able to provide the desired level of accuracy and efficiency. This paper reports the development of an AOI platform for 3D defect detection on GMOCs. The platform incorporates 3D video acquisition and a novel two-stage neural network machine-learning algorithm. It includes a robotic arm for moving parts in 3D, a camera with an illumination module for video acquisition, and a video streaming processing unit with a machine vision algorithm for real-time defect detection on a production line. The robotic arm enables multi-perspective video capture of a test sample without refocusing. The two-stage machine learning network uses a modified YOLOv4 architecture with color channel separation (CCS) convolution, an image quality evaluation (IQE) module, and a frame fusion module to integrate the single frame detection results. This network can process multi-perspective video streams in real-time for defects detection in a coarse-to-fine manner. The AOI platform was trained with only 30 samples and achieved promising performances with a recall rate of 1, a detection accuracy of 97%, and an inspection time of 48 s per part. •In order to solve the challenging problem of defect detection on transparent optical components with 3D shape and random defect locations, a novel optical inspection platform based on video stream is developed to capture multi-perspective images of the object, and machine learning based algorithms is used to identify the defects.