**Setting:** Recall that there is an unknown vector \(z=\mathbf{W}\cdot g_{\theta}(p)\in\mathds{R}^{\ell}\) (i.e., the logits for a given prompt \(p\)) that we want to recover. We can make multiple queries to the API with the same prompt \(\mathcal{O}(p,b)\). Each query is specified by a vector \(b\in\mathds{R}^{\ell}\) (a.k.a. the logit bias).