There have already been some safety-critical benchmarks to evaluate the efficacy of safe RL methods, including traditional MuJoCo tasks [1]}, [2]}, navigation in the cluttered environment [3]}, safe robotic control task [4]} and safe autonomous driving [5]}, [6]}. However, a comprehensive study on learning a zero-cost-return policy with model-free methods is still absent.
