The goal of balanced sampling of all output tokens can be approached in many ways. For example, we could tune \(c\) in the above expression; bias tokens which \(\mathcal{O}\) hasn't returned previously to be more likely; or solve for the exact logit bias that separates \(\mathcal{C}\) (or some relaxation) into equal parts. the queries/logit metric of this method in Table 3 is surprisingly close to optimal.