We collect 3,047 human–human gameplay sessions for completing household tasks in the AI2-THOR simulator [1]}.
Each session includes an initial environment state, Commander actions to access oracle information, utterances between the Commander and Follower, movement actions, and object interactions taken by the Follower.
Figure REF  gives an overview of the annotation interface.
