Towards Model-Free Pressure Control in Water Distribution Networks

Pressure control in water distribution networks (WDNs) is one of the interventions commonly employed to improve the reliability and sustainability of water supply. Various approaches have been proposed to solve the problem of pressure control. However, most schemes that have been proposed rely on the accuracy of a model in order to precisely control a real WDN. Therefore, any deviation between a model and real WDN parameters could render the results of control schemes useless. As a result, this work proposes the utilisation of the reinforcement learning (RL) technique to control nodes pressure in WDNs without solving the model. Quadratic approximation emulators of WDNs and RL agents are used in the proposed scheme. The effectiveness of the proposed scheme is tested on two WDNs networks and the results are compared with the conventional optimisation scheme that is commonly used for simulation cases. The results show that the proposed scheme is able to achieve the desired results when compared to the benchmark optimisation procedure. However, unlike the optimisation procedure, the proposed scheme achieved the results without the numerical solution of the WDNs. Therefore, this scheme could be used in situations where the model of a network is not well defined.