In this study, we utilize a model-free RL algorithm to solve simulation-based robust optimal control problem where the model information is assumed to be partially available.
Robust optimal well control in petroleum reservoir management [1]}, [2]}, [3]} forms a perfect candidate for such problem.
In this problem, the reservoir well control variables are optimized in order to maximize the sweep efficiency of injection fluid throughout the reservoir life cycle.
The assumption of partially available model information is based on the fact that the reservoir field data is generally only available at well locations.
We consider reservoir permeability field as an uncertain model parameter.
Results are demonstrated for two state of the art model-free RL algorithms: proximal policy optimisation [4]} and advantage actor-critic [5]}.
Although we utilize robust well control in the current study, the presented techniques are general and is applicable to a wide range of simulation-based nonlinear optimal control problems.
