Figure 5: Prediction errors of the five-domain data mixing laws fitted with explicit and implicit domain aggregation. _Explicit domain aggregation_: we fit Eqn. 7 for five domains respectively and sum them up according to their weight in the overall validation sets. _Implicit domain aggregation_: we fit the losses on overall validation with Eqn. 8, assuming different numbers of implicit domains \(K\) and treating the proportion of different implicit domains as learnable parameters.