Normalization. States normalization is applied differently for different kinds of environment. In continuous control tasks, states are normalized by maintaining running statistics. For video games, following the setup in [1]}, state's mean and standard deviation values are computed on 10,000 steps collected using a random agent, and are kept fixed during training.
