The previous sections assume we have access to the full language model output probability vector. However, many language model platforms limit the information returned from API calls. For example, a well-known service's API only exposes either samples or the top-5 log probabilities, but does not expose all output probabilities for a given input.