As mentioned in Section 4.5, we analyze Llama2's Data-to-Model Ratio based on their training loss curve. The extracted loss is plotted on the left of Figure 18. We convert the x-axis to computation Flops to compare the compute optimal regime on the right part of the Figure.