Results.Fig. 6 shows the default mixture of RedPajama used in Touvron et al. (2023a) and the optimized mixture obtained from Alg. 1 with their performance on the validation data. The loss predictions are in Fig. 7.