Initially, emergent communication between RL agents was largely studied in one-step referential games, such as the Lewis task [1]}, [2]}, [3]}, [4]}, [5]}. The Lewis task [6]} is a cooperative game, where the speaker sees an artifact (e.g., an image) and communicates a message from a fixed vocabulary (e.g., a symbol) to the listener, who then interprets the message to select a target item from among a set of distractors. This type of learning environment is known to successfully enable language development [7]}. However, this setting does not recreate the temporal aspects of a real-world environment, which may influence the structure of the emergent languages.
