Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning

In this paper, a stochastic model predictive control (MPC) method based on reinforcement learning is proposed for energy management of plug-in hybrid electric vehicles (PHEVs). Firstly, the power transfer of each component in a power-split PHEV is described in detail. Then an effective and convergent reinforcement learning controller is trained by the Q-learning algorithm according to the driving power distribution under multiple driving cycles. By constructing a multi-step Markov velocity prediction model, the reinforcement learning controller is embedded into the stochastic MPC controller to determine the optimal battery power in predicted time domain. Numerical simulation results verify that the proposed method achieves superior fuel economy that is close to that by stochastic dynamic programming method. In addition, the effective state of charge tracking in terms of different reference trajectories highlight that the proposed method is effective for online application requiring a fast calculation speed. •Stochastic model predictive control is achieved based on reinforcement learning.•The Q-learning algorithm is employed to build the reinforcement learning controller.•A multi-step Markov velocity prediction model is embedded into the controller.•The proposed method achieves superior fuel economy with fast calculation speed.