Output feedback control with known and convexifiable reward has been studied extensively [1]}, and linear dynamic controllers suffice for this case. However, in our problem setting, since the reward is unknown and nonconvex, and systems dynamics will become uncertain and nonlinear in Section , we consider a dynamic controller in the form of an RNN, which makes a class of high-capacity flexible controllers.
