In **Autoregressive Language Modeling** framework, given a sequence of \(n\) tokens \(x_{1}\),..., \(x_{n}\), the model tries to predict next token \(x_{n+1}\) (and sometimes next sequence of tokens) in an auto-regressive fashion.