We introduce Task-driven Embodied Agents that Chat (TEACh)https://github.com/alexa/teach to study how agents can learn to ground natural language [1]}, [2]} to the visual world and actions, while considering long-term and intermediate goals, and using dialogue to communicate.
TEACh contains over 3,000 human–human sessions interleaving utterances and environment actions where a Commander with oracle task and world knowledge and a Follower with the ability to interact with the world communicate in written English to complete household chores (Figure REF ).
