I am running a Q-learning algorithm with a finite time horizon.  Are 'optimistic initial conditions' still preferred if there is a possibility that some states will not be visited multiple times?Wikipedia on Initial Q Values
Initial Q-values in Q-Learning
machine learning;reinforcement learning;q learning