Update README.md

README.md

@@ -17,8 +17,7 @@ This is a collection of the language models trained using Pile-CC, each with app
 ## Key Features
 
 - **Model Size**: 5 separate models trained with different seeds, each with ~1B parameters
-- **Training Data**: Human selection (from The Pile paper) data mixtures on the [RegMix-Data](https://huggingface.co/datasets/sail/regmix-data) dataset
-- **Purpose**: The Human selection is a strong baseline for our method RegMix
+- **Training Data**: The pile-cc only data mixture on the [RegMix-Data](https://huggingface.co/datasets/sail/regmix-data) dataset
 
 ## Dataset
 
@@ -42,8 +41,8 @@ You can load any model using the corresponding branch with the Hugging Face Tran
 ```python
 from transformers import AutoModel, AutoTokenizer
 
-model = AutoModel.from_pretrained("sail/data-mixture-human-1b", revision="seed-1")
-tokenizer = AutoTokenizer.from_pretrained("sail/data-mixture-human-1b", revision="seed-1")
+model = AutoModel.from_pretrained("sail/data-mixture-pile-cc-1b", revision="seed-1")
+tokenizer = AutoTokenizer.from_pretrained("sail/data-mixture-pile-cc-1b", revision="seed-1")
 ```
 
 ## Data Mixture