For baselines, we compare our methods against AE COMM [1]} which grounds communication by reconstructing encoded observations, DIAL [2]} which learns to communicate through differentiable communication, and independent RL without communication.
