To alleviate these issues adaptive novelty detection methods [1]} are implemented in the CWB-RS to recognize situations far from the agent experience and handover the control to educators or a safe controller.
Moreover, the HRL paradigm has been adopted for the CWB-RS to constrain and minimize exploration risks and costs [2]}, [3]} while providing direct control and interpretability to the educators [4]}, [5]}. Ultimately, under the direction of learning objectives and strategies, the set of problems that the CWB-RS will have to solve would be limited to balancing reranking requests from different active strategies and prioritizing one objective over the few others defined in the current high-level learning strategy.
