We are motivated by [1]} and [2]} to consider the rollout horizon \(h\in \left\lbrace 1,3,5\right\rbrace \) .
We use \(h=1\)  for
halfcheetah-medium, hopper-medium, hopper-medium-replay, maze2d-large, pen-expert, door-expert, pen-human;
\(h=3\)  for
hopper-medium-expert, walker2d-medium, halfcheetah-medium-replay, maze2d-umaze, maze2d-medium;
and \(h=5\)  for
halfcheetah-medium-expert, walker2d-medium-expert, walker2d-medium-replay, pen-cloned.
