**Protocols**: In addition to the evaluation metrics, another important aspect for objective evaluation is how to leverage these metrics. In the previous work, we can identify the following commonly used evaluation protocols: (1) _Real-world simulation:_ In this method, the agents are evaluated within immersive environments like games and interactive simulators.