Both agents were trained for 2e10 steps (.44e6 training episodes; 1e9 episodes for the symbolic version of the task), and evaluated without weight updates on 1000 test episodes. Note that to surpass a zero score, both agents required kickstarting [1]}, with agents first trained on a fixed chemistry with shaping rewards included for each potion use.
Agents trained on the symbolic version of the task were trained from scratch without kickstarting.
