tonomously, and then metrics like task success rate and human similarity are leveraged to evaluate the capability of the agents based on their trajectories and completed objectives [164, 166, 167, 33, 38, 59, 85, 138, 164, 170]. This method is expected to evaluate the agents' practical capabilities in real-world scenarios. (2) _Social evaluation_: This method utilizes metrics to assess social intelligence based on the agent interactions in simulated societies. Various approaches have been adopted, such as collaborative tasks to evaluate teamwork skills, debates to analyze argumentative reasoning, and human studies to measure social aptitude [165, 173, 34, 79, 102]. These approaches analyze qualities such as coherence, theory of mind, and social IQ to assess agents' capabilities in areas including cooperation, communication, empathy, and mimicking human social behavior. By subjecting agents to complex interactive settings, social evaluation provides valuable insights into agents' higher-level social cognition. (3) _Multi-task evaluation:_ In this method, people use a set of diverse tasks from different domains to evaluate the agent, which can effectively measure the agent generalization capability in open-domain environments [165, 172, 173, 166, 85, 29, 85]. (4) _Software testing:_ In this method, researchers evaluate the agents by letting them conduct tasks such as software testing tasks, such as generating test cases, reproducing bugs, debugging code, and interacting with developers and external tools [162, 169, 163, 169]. Then, one can use metrics like test coverage and bug detection rate to measure the effectiveness of LLM-based agents.