[Proof of Theorem REF ]
We follow a similar procedure to [1]}, except we do not have to decompose the regret into a recursive form in \(h\)  since we are interested in a fixed \(h=1\) .
We denote \(\delta _1^k := (V_1^k - V_1^{\pi _1^k})(x1)\) .
