For the experiments on Atari, we build on the codebase from [1]} and extend it by introducing a temporal latent bottleneck. We test it on the same four games (Breakout, Pong, Seaquest, Qbert) as [1]}. The model is trained on 1% of the Atari DQN-replay dataset [3]} (500K transitions for each game).
