EleutherAI
/

Hermes-RWKV-v5-7B

Model card Files Files and versions Community

norabelrose commited on Mar 20

Commit

285feaf

•

1 Parent(s): f4b751a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ datasets:
 language:
 - en
 ---
-This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
 The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.

 language:
 - en
 ---
+This is a 7B parameter RWKV-v5 ("Eagle") RNN language model pretrained on over 1T tokens of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
 The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.