To validate our hypothesis, we conduct an analysis through dimensionality reduction of the latent space of our deep policy network.
This is a common approach to better understand how different game states are perceived by the agent and how they relate to the estimated value function [1]}, [2]}.
Figure REF , presents tSNE embeddings [3]} computed with the Approximated-tSNE method [4]}, of the game states obtained by letting different bots playing against the scripted agent for 20 games.
<FIGURE>