Urban wastewater sector is being pushed to optimize processes in order to reduce energy consumption without compromising its quality standards. Energy costs can represent a significant share of the global operational costs (between 50 and 60 ) in an intensive energy consumer. Pumping is the largest consumer of electrical energy in a wastewater treatment plant. Thus, the optimal control of pump units can help the utilities to decrease operational costs. This work describes an innovative predictive control policy for wastewater variable-frequency pumps that minimize electrical energy consumption, considering uncertainty forecasts for wastewater intake rate and information collected by sensors accessible through the Supervisory Control and Data Acquisition system. The proposed control method combines statistical learning (regression and predictive models) and deep reinforcement learning (Proximal Policy Optimization). The following main original contributions are produced: i) model-free and data-driven predictive control; ii) control philosophy focused on operating the tank with a variable wastewater set-point level; iii) use of supervised learning to generate synthetic data for pre-training the reinforcement learning policy, without the need to physically interact with the system. The results for a real case-study during 90 days show a 16.7 decrease in electrical energy consumption while still achieving a 97 reduction in the number of alarms (tank level above 7.2 meters) when compared with the current operating scenario (operating with a fixed set-point level). The numerical analysis showed that the proposed data-driven method is able to explore the trade-off between number of alarms and consumption minimization, offering different options to decision-makers.
The optimal operation scheduling of a pumping station with multiple pumps is formulated as a dynamic programming problem. Based on the characteristics of the problem, an extended reduced dynamic programming algorithm (RDPA) is proposed to solve the problem. Both the energy cost and the maintenance cost are considered in the performance function of the optimization problem. The extended RDPA can significantly reduce the computational time when it is compared to conventional DP algorithms. Simulation shows the feasibility of the reduction of the operation cost. We address the day-ahead pump scheduling problem for a class of branched water networks with one pumping station raising water to tanks at different places and levels. This common class is representative of rural drinking water distribution networks, though not exclusively so. Many sophisticated heuristic algorithms have been designed to tackle the challenging general problem. By focusing on a class of networks, we show that a pure model-based approach relying on a tractable mathematical program is pertinent for real-size applications. The practical advantages of this approach are that it produces optimal or near-optimal solutions with performance guarantees in near real-time, and that it is replicable without algorithmic development. We apply the approach to a real drinking water supply system and compare it to the current operational strategy based on historical data. An extensive empirical analysis assesses the financial and practical benefits: (1) it achieves significant savings in terms of operation costs and energy consumption, (2) its robustness to dynamic pricing means that demand-response can be efficiently implemented in this type of energy-intensive utility. Significant changes in the power generation mix are posing new challenges for the balancing systems of the grid. Many of these challenges are in the secondary electricity grid regulation services and could be met through demand response (DR) services. We explore the opportunities for a water distribution system (WDS) to provide balancing services with demand response through pump scheduling and evaluate the associated benefits. Using a benchmark network and demand response mechanisms available in the UK, these benefits are assessed in terms of reduced green house gas (GHG) emissions from the grid due to the displacement of more polluting power sources and additional revenues for water utilities. The optimal pump scheduling problem is formulated as a mixed-integer optimisation problem and solved using a branch and bound algorithm. This new formulation finds the optimal level of power capacity to commit to the provision of demand response for a range of reserve energy provision and frequency response schemes offered in the UK. For the first time we show that DR from WDS can offer financial benefits to WDS operators while providing response energy to the grid with less greenhouse gas emissions than competing reserve energy technologies. Using a Monte Carlo simulation based on data from 2014, we demonstrate that the cost of providing the storage energy is less than the financial compensation available for the equivalent energy supply. The GHG emissions from the demand response provision from a WDS are also shown to be smaller than those of contemporary competing technologies such as open cycle gas turbines. The demand response services considered vary in their response time and duration as well as commitment requirements. The financial viability of a demand response service committed continuously is shown to be strongly dependent on the utilisation of the pumps and the electricity tariffs used by water utilities. Through the analysis of range of water demand scenarios and financial incentives using real market data, we demonstrate how a WDS can participate in a demand response scheme and generate financial gains and environmental benefits. 