Recent work increasingly explores multi-step tasks that enable temporally extended dialogue, more similar to real-world environments [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, [7]}. Cao et al. (2018) investigate multi-step negotiation. Jaques et al. (2019) test communication emergence during Sequential Social Dilemmas in environments, such as Harvest or Cleanup. Evtimova et al. (2018) propose a multi-modal, multi-step referential task (a modified version of the Lewis task). Bouchacourt and Baroni (2019) introduce a fruit-tool matching game, similar to a multi-step Lewis task but with a preference-based reward. Here, we build on this body of work by introducing a multi-step navigation task in a gridworld environment. In Appendix REF , we elaborate on how our task compares to existing work and on the direct impact of introducing multi-step communication in this task.
