tasks agents with taking in language instructions and a visual observation to produce an action, such as turning or moving forward, to receive a new visual observation.
VLN benchmarks have evolved from the use of symbolic environment representations [1]}, [2]}, [3]} to photorealistic indoor [4]} and outdoor environments [5]}, as well as the prediction of continuous control [6]}.
TEACh goes beyond navigation to object interactions for task completion, and beyond single instructions to dialogue.
