We introduce the off-beat action into SMAC [1]}. To make reasonable changes of the environment, we select the ATTACK actions as off-beat actions for SMAC scenarios. The rest actions, including MOVE, NOOP will be executed immediately into the environment after inference. At each time step, agents get local observations within their field of view, which contains information (relative x, relative y, distance, health, shield, and unit type) about the map within a circular area for both allied and enemy units and makes the environment partially observable for each agent. All features, both in the global state and in individual observations of agents, are normalized by their maximum values. Actions are in the discrete space: move[direction], attack[enemy id], stop and no-op. The no-op action is the only legal action for dead agents. Agents can only move in four directions: north, south, east, or west.
