The approach from the previous subsection extends to the setting where each API query returns the top \(K\) logprobs. In practice we work with \(K=5\). We are able to recover \(K\) logits. Again, instead of using a reference token to normalize the logits, we will normalize \(\sum_{j}\exp(z_{j})=1\). However, in this setting we will need to solve a \(K\)-by-\(K\) system of linear equations.