A Mode-Switching Motion Control System for Reactive Interaction and Surface Following Using Industrial Robots

This work proposes a sensor-based control system for fully automated object detection and exploration &#x0028 surface following &#x0029 with a redundant industrial robot. The control system utilizes both offline and online trajectory planning for reactive interaction with objects of different shapes and color using RGB-D vision and proximity &#x002F contact sensors feedback where no prior knowledge of the objects is available. The RGB-D sensor is used to collect raw 3D information of the environment. The data is then processed to segment an object of interest in the scene. In order to completely explore the object, a coverage path planning technique is proposed using a dynamic 3D occupancy grid method to generate a primary &#x0028 offline &#x0029 trajectory. However, RGB-D sensors are very sensitive to lighting and provide only limited accuracy on the depth measurements. Therefore, the coverage path planning is then further assisted by a real-time adaptive path planning using a fuzzy self-tuning proportional integral derivative &#x0028 PID &#x0029 controller. The latter allows the robot to dynamically update the 3D model by a specially designed instrumented compliant wrist and adapt to the surfaces it approaches or touches. A mode-switching scheme is also proposed to efficiently integrate and smoothly switch between the interaction modes under certain conditions. Experimental results using a CRS-F3 manipulator equipped with a custom-built compliant wrist demonstrate the feasibility and performance of the proposed method.