sail
/

data-mixture-doremi-1b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

SivilTaram commited on Jul 4

Commit

6d7b06c

•

1 Parent(s): 5c7c749

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ tags:
 ---
-# Models Trained with Human Selection
 This is a collection of the language models trained using DoReMi data mxiture, each with approximately 1B parameters, trained on different random mixtures of data. This models aims to server as the strong baseline for our RegMix approach (https://huggingface.co/papers/2407.01492).

 ---
+# Models Trained with DoReMi Data Mixture
 This is a collection of the language models trained using DoReMi data mxiture, each with approximately 1B parameters, trained on different random mixtures of data. This models aims to server as the strong baseline for our RegMix approach (https://huggingface.co/papers/2407.01492).