Vision Systems for a UR5 Cobot on a Quality Control Robotic Station

This paper addresses the development of a vision system for the UR5 cobot and the corresponding operating algorithm of the robotic quality control station. The hardware–software architecture of the developed robotic station consisting of a UR5 cobot equipped with a web camera and a stationary industrial camera with a lighting system is presented. Image processing and analysis algorithms are described, the method of control and communication between the station components is discussed, and operating scenarios are presented as a single robotic station and as a part of the robotic line. Based on the results which were obtained, the level of measurement noise, accuracy, and repeatability of the developed vision system were estimated. A novel complete vision system architecture with hardware–software modules for the UR5 cobot quality control station is shown and discussed. The software part based on Python 3.12 language, OpenCV 4.7.0.68 libraries, and the PolyScope 1.8 environment incorporates modules for system calibration, image acquisition, preprocessing and image analysis (for objects’ location and geometric measurements) and for robotic cell communication and control. The hardware part of the UR5 cobot vision system is based on a PC with two independent and distinct cameras: one permanently affixed and the other mounted to the cobot’s flange. This innovative setup, combined with software architecture, broadens the scope of existing robotic quality control applications.