We perform experiments on various multi-agent scenarios with off-beat actions. We introduce off-beat actions in Stag-Hunter Game, Quarry Game, Afforestation Game and StarCraft II micromanagement tasks [1]} and use them as testbeds in our experiments. We aim to answer the following questions: Q1: Can our LeGEM improve the multi-agent coordination of many MARL methods in OBMAS? Q2: Can our LeGEM outperform previous parameterized episodic memory (EM) for MARL?
Q3: Can bootstrapping method of RL help? Q4: Can our LeGEM outperform the multi-agent exploration and multi-agent risk-sensitive (Ex-Risk) methods?
<FIGURE>