Subjective evaluation measures the agent capabilities based on human judgements [20, 22, 29, 79, 158]. It is suitable for the scenarios where there are no evaluation datasets or it is very hard to design quantitative metrics, for example, evaluating the agent's intelligence or user-friendliness. In the following, we present two commonly used strategies for subjective evaluation.