In this section we present our algorithm, \(Q\) -learning with UCB-Hoeffding and Max-Optimal Initialization, a modified version of Algorithm 1 from [1]}. We also introduce a theorem that shows the total regret of our algorithm is \(O(\sqrt{H^2T\iota ^{\prime }})\) .
