the restricted TS policies used in the Adaptively-Weighted Augmented Inverse Probability Weighing [1]} and Batched Ordinary Least Squares [2]} methods, and an Oracle that always allocates the highest mean reward arm [3]}. Note that regret is the difference between the performance of the oracle and the TS policies.
