Since the effectiveness of \(Q\) -function reuse has been mostly shown in the model-free setting [1]}, and it is easier to perform a theoretical analysis in the tabular domain, we choose to study the effects of \(Q\) -function reuse on a tabular, model-free algorithm that is provably efficient, \(Q\) -learning with UCB-Hoeffding [2]}.
In this work we study the setting where we are given the \(Q\) -function from some agent that has previously been trained on a simple MDP \(\mathcal {M}_S\) .
We refer to this \(Q\) -function as the pre-trained \(Q\) -function from \(\mathcal {M}_S\) .
We will answer the following question:
