Reset mechanism. We have modeled the pump scheduling as an episodic POMDP where the agent interacts for a limited number of timesteps. Therefore, our configuration is reset-free, which means no mechanism is applied to start an episode under a known distribution of initial states. In other words, it means that the last step of an episode is the initial one for the next episode. Thus, a suitable policy must be robust to handle the variability of initial conditions, providing dynamism challenge [1]}.
