**Robotics & Embodied Artificial Intelligence**: Recent works have developed more efficient reinforcement learning agents for robotics and embodied artificial intelligence [16; 140; 132; 133; 134; 135; 141; 136; 137; 138; 139; 140; 142; 143]. The focus is on enhancing autonomous agents' abilities for planning, reasoning, and collaboration in embodied environments. In specific, [140] proposes a unified agent system for embodied reasoning and task planning. In this system, the authors design high-level commands to enable improved planning while propose low-level controllers to translate commands into actions. Additionally, one can leverage dialogues to gather information [141] to accelerate the optimization process. [142; 143] employ autonomous agents for embodied decision-making and exploration. To overcome the physical constraints, the agents can generate executable plans and accomplish long-term tasks by leveraging multiple skills. In terms of control policies, SayCan [78] focuses on investigating a wide range of manipulation and navigation skills utilizing a mobile manipulator robot. Taking inspiration from typical tasks encountered in a kitchen environment, it presents a comprehensive set of 551 skills that cover seven skill families and 17 objects. These skills encompass various actions such as picking, placing, pouring, grasping, and manipulating objects, among others. TidyBot [137] is an embodied agent designed to personalize household cleanup tasks. It can learn users' preferences on object placement and manipulation methods through textual examples.