Limitations of the approach.If \(\mathsf{logit}_{i}-\mathsf{logit}_{0}<-2B\) it is easy to see there is no efficient way to sample the token \(i\), hence no way to find information about \(\mathsf{logit}_{i}\) without \(\log\!rob\) access. There is a way to slightly increase the range for \(-2B\leq\mathsf{logit}_{i}-\mathsf{logit}_{0}\leq-B\) by adding negative logit biases to the tokens with the largest logit values, but we skip the details since for most models, for the prompts we use, the every token satisfies \(\mathsf{logit}_{i}-\mathsf{logit}_{0}>-B\).