An improved cost-optimal attack.It is possible to generalize the above attack to improve _both_ the query cost and token cost. Instead of issuing queries to the model that reveal 4 or 5 logit values for a single generated token, we might instead hope to be able to send a multi-token query \(\begin{bmatrix}p_{0}&p_{1}&p_{2}\dots p_{n}\end{bmatrix}\) and then ask for the logprob vector for each prefix of the prompt \(\begin{bmatrix}p_{0}\end{bmatrix}\), \(\begin{bmatrix}p_{0}&p_{1}\end{bmatrix}\), \(\begin{bmatrix}p_{0}&p_{1}&p_{2}\end{bmatrix}\) etc. OpenAI's API did allow for queries of this form in the past, by providing logprobs for _prompt_ tokens as well as generated tokens by combining the logprob and echo parameters; this option has since been removed.