where \(\mathsf{ArgMax}\left(\mathbf{z}\right)\) returns the index of the highest coordinate in the vector \(\mathbf{z}\in\mathbb{R}^{I}\). In this section, we will use the notation \(b=\{i:z\}\) to denote that the bias is set to \(z\) for token \(i\) and \(0\) for every other token. We also use \(b=\{\}\) to denote that no logit bias is used. Finally, we assume that the bias is restricted to fall within the range \([-B,B]\).