**Deduplication** After implementing a filtration process, we've developed a comprehensive deduplication pipeline. This pipeline includes document-level exact deduplication, document-level Minhash deduplication, and intra-document-level similar line deduplication, effectively identifying and removing duplicate content within documents. For exact deduplication, to reduce memory pressure we utilize a Bloom filter to approximate with a false positive rate set at 0.001. In the case of Minhash LSH, the signature is constructed from 128 hash functions and organized into 9 bands and 13 rows for LSH, achieving a Jaccard similarity of 0.8. The intra-document-level similar line deduplication targets removing repetitive lines within a single document. This approach was motivated by our observation that a significant portion of web-crawled data contained repetitions of 2 to 3 times within the same page, and due to the process of extracting text from HTML, some words might be lost, leading to slight variations in duplicates. For this deduplication, we employ edit distance to determine line similarity. The specific criterion is that two lines are considered similar if their edit distance is less than one-tenth of the length of the shorter line.