All environments in our experiments are physics-based environments simulated using the MUJOCO engine [1]}. Agents are point-like objects that can move and rotate by applying a force. Agents have an additional pull action that allows them to drag objects. In Hide and Seek, agents can also lock and unlock a (subset of) objects in place.
