A user behavior and reinforcement learning based dynamic pricing method for idle connection time reduction at charging stations

Reducing idle connection time is crucial for improving the operational efficiency of charging stations and enhancing the satisfaction of electric vehicle (EV) users. During idle connection time, EVs occupy charging spots without actively charging, thus preventing other vehicles from accessing them. However, there has been limited research focusing on how to shorten the idle connection time of charging stations. This study employed a stated preference survey to develop four separate logit models within the framework of mixed logit model that examines the impact of pricing strategies on the choice behavior of idle connection time and the underlying mechanisms behind drivers’ choice behavior in various durations of idle connection time (brief, moderate, lengthy, and extra-lengthy). Taking a charging station in Suzhou, China as a case study area, we developed a dynamic pricing algorithm based on Deep Q-Network reinforcement learning and choice behavior to minimize idle connection time and pricing at the charging station. The results indicate that factors such as pricing, location, charging start time, and the search time for available parking spaces have a significant impact on reducing idle connection time. Additionally, such impact varies across different durations of idle connection time, and the dynamic pricing strategy proves to be effective in reducing idle connection time. Compared to fixed pricing and semi-fixed pricing strategies, the dynamic pricing strategy can accommodate more potential charging demands at lower fee rates. The findings of this study offer valuable insights and a theoretical foundation for the real-time proactive management of EV charging stations.