In Appendix E we present a second, more sophisticated method that allows us to recover 5 logits per query, i.e., a cost of \(1/5\), by viewing each logprob we receive as a linear constraint on the original logits.