Deep RL Based Notch Filter Design Method for Complex Industrial Servo Systems

This paper proposes a deep reinforcement learning (deep RL) method for simultaneously designing several notch filters in complex industrial servo systems. Notch filters are highly effective for suppressing resonances in motion control systems and are widely utilized in industry. However, severe limitations exist in complex servo systems because there are many vibration modes that are difficult to identify. In such cases, several notch filters must be used, but the task of tuning these filters involves lengthy empirical procedures by well-experienced engineers. To automate this tuning process, this paper proposes a novel design method that can design several notch filters simultaneously for the first time. In this method, a deep deterministic policy gradient (DDPG) algorithm with a vector stability margin as the reward function is utilized to find filter parameters in the frequency domain. The proposed method simultaneously finds a set of many parameters for several notch filters that are optimal with respect to stability. Using a real industrial servo system that has multiple resonances, it is demonstrated that the proposed method effectively finds the optimal parameters for several notch filters and successfully suppresses multiple resonances to provide desired performances.