This setting can be made _autoregressive_ by generating sequences step by step, using the preceding output as the next input. We can think of each successive pair of tokens as of the pairs \((i,j)\) above, with the only difference that the marginal distribution \(p(i)\) changes. We thus will make no assumptions on \(p(i)\) in what follows (except for a mild technical condition). Proofs can be found in Appendix D.