_Remark 3.5_ (why "random data").: Studying a lower bound for a fixed dataset \(\mathcal{Z}\) is impossible -- a model could hard-code \(\mathcal{Z}\) into its architecture even without any trainable parameter. Therefore, it is necessary to consider a lower bound with respect to a _distribution_ over datasets.