
Here, \(C_{kh}\)  and \(B_{kh}\)  are algorithm-dependent quantities. Naturally, the value-optimistic algorithms compute value functions of this form. Examples of value-optimistic algorithms include: UBEV, UCBVI-CH, UCBVI-BF [1]}, [2]}. However, recent work proved that model-optimistic algorithms share this form too [3]}. Some model-optimistic algorithms include: UCRL2, KL-UCRL and UCRL2B [4]}, [5]}, [6]}. For UCRL2, \(C_{kh} = H\sqrt{S\log (SAT/\delta )}\)  and \(B_{kh} = 0\)  [3]}.
