DQN-based expressway entrance ramp control method

The invention discloses a DQN-based expressway entrance ramp control method. The method comprises the following steps: modeling a road network model according to an actual road network, designing various traffic demands, and adjusting a vehicle following model and a vehicle lane changing model; designing ramp control signal timing as action selection, changing the ramp control signal timing to adjust the turn-in rate of the ramp traffic flow, and changing the green light duration to adjust the number of vehicles entering the main line; the actual congestion condition of the expressway is reflected by the change of the total travel time, the goal of the minimum total travel time is converted into the goal of enabling the lane occupancy rate of the main line to be close to the expected occupancy rate, a reward function is established, and hierarchical control is performed on the reward function through the number of vehicles queued on the ramp; and training the DQN by using various traffic demands, and taking t