Therefore, comparing \(\mathsf{bioS}\) and \(\mathsf{bioS}^{\mathsf{simple}}\), it's more advantageous to rewrite the data 1000 times (in this ideal setting), training each for one pass (as done in the \(\mathsf{bioS}\) data), rather than training the same data for 1000 passes (as done in the \(\mathsf{bioS}^{\mathsf{simple}}\) data). This is because, without data diversity, the model wastes capacity memorizing sentence structures, resulting in a capacity loss.