**Emergent abilities.**[47] propose the idea of emergent abilities, abilities that only present in large language models. This is similar to the claim of [13] that it is more difficult to predict the capacities of language models than to predict the pre-training loss. The existence of emergent abilities has been challenged. [16] show that smaller language models trained with sufficient data can outperform undertrained larger language models, supported by follow-up models [44; 19; 45]. On the other hand, [37] claim that emergent abilities are due to the discontinuos metrics used for evaluation, also found in [49]. Similarly, [17] propose to predict the performance of emergent abilities with the infinite resolution evaluation metric. In this paper we prove the existence of emergent abilities from the perspecitve of pre-training loss, even with continuous metrics.