Situated and task-oriented natural language interactions [1]}, [2]} have been studied in a variety of environments, including in custom 2D worlds [3]}, [4]}, [5]}, in the physical world with human-robot interactions [6]}, [7]}, [8]}, [9]}, and in various 3D virtual worlds [10]}, [11]}. Most closely, our environment builds upon recent work by [12]} and [13]}, whereby computational models of user dialogue prediction and user next-action prediction are investigated in the setting of a collaborative dialogue task within the 3D virtual blocks world of Minecraft.
However, to our knowledge, none of these previous works explicitly model theory of mind for dialogue agents.
