The method we presented earlier uses a reference token. We set this to some arbitrary value (e.g., 0) and then compare the logits for all other tokens to this one. This approach is numerically stable, but is slightly wasteful: of the top \(K\) logprobs returned by the API, one is always the reference token. Hence, we only recover \(K-1\) logits per query with this method.