Specialized Knowledge TasksThe key message from the results in Table 2 is that synthetic data can not impart 'new knowledge'. It can only help pre-train faster, which was also the premise of our work.