We focus on the maximal expressiveness of a lower-dimensional head: when provided with _perfect_ contextual representations \(x_{i}^{*}\), what is the maximal performance level of a linear language modeling head of maximal rank \(d\)?