A number of tabular RL methods exist; most popular ones include TD-learning [1]}, SARSA [2]}, Q-Learning [3]} and double Q-Learning [4]}. Here we focus on the \(Q\) -Learning algorithm that provides specific convergence guarantees [3]}We have experimented with most of the tabular methods and found their branch prediction performance to be similar..
