**Proof difficulties.** If names are fixed (\(\mathcal{N}=\mathcal{N}_{0}\)) and there are \(N\) pieces of knowledge, each uniformly chosen from a fixed set \([T]\), it is straightforward that any model \(F(W)\), capable of learning such knowledge _perfectly_, must satisfy \(\log_{2}|\mathcal{W}|\geq N\log_{2}T\). To relate this to Theorem 3.2, we encounter three main challenges. First, the model \(F\) may only learn the knowledge with a certain degree of accuracy, as defined by the cross-entropy loss. Second, \(\mathcal{N}\neq\mathcal{N}_{0}\) so names need to be learned -- even a perfect model cannot achieve zero cross-entropy loss when generating names. Third, there is a dependency between knowledge pieces -- the value depends on the name and the choice of the diversity set (i.e., \(\mathcal{D}_{a}\)). The proof of Theorem 3.2 is deferred to Appendix F.