Whilst [1]} relate epistemic uncertainty to the one-step Bellman error, we believe it should be related to full trajectories instead due to \(Q\) -values being learned through bootstrapping rather than ground truth targets.
