Continuous action-space. The set of actions of the water distribution system is discrete. There is a finite set of pumps that operate with a fixed speed beside the option to turn all of them off. Although not explored in previous works, the simulator can adapt to variable speed pump(s). Then, approaches suitable for continuous action space, such as actor-critic [1]}, can be evaluated while exploring the environment.
