Models were trained as described in Appendix . In addition, we assumed a discount factor of \(\gamma =0.9\)  for this set of experiments. A geometric discount factor can be interpreted as a modification to the task dynamics such that an agent believes to reach a terminal state with probability \(1 - \gamma \)  [1]}. We used this interpretation of the discount factor to model that participants in the IGT are not informed about the duration of the task.
