where \(\mathsf{TopK}\left(\mathbf{z}\right)\) returns the \(K\) highest entries of \(\mathbf{z}\in\mathbb{R}^{l}\) and their indices. Many APIs (prior to this paper) provided such an option for their state-of-the-art models (OpenAI, 2024; Google, 2024). In particular, the OpenAI API supports modifying logits for at most \(300\) tokens, and the logit bias for each token is restricted to the range \([-100,100]\)(OpenAI, 2023).