Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ This is updated from [decapoda-research/llama-13b-hf](https://huggingface.co/dec
|
|
12 |
|
13 |
(1) The naming changes (LLaMA -> Llama) to best fit for `transformers` naming rule, in both `LlamaForCausalLM` and `LlamaTokenizer`. This works perfectly for `transformers>=4.28.0`.
|
14 |
|
15 |
-
(2) The model checkpoints are saved in 3 shards (instead of
|
16 |
|
17 |
--
|
18 |
license: other
|
|
|
12 |
|
13 |
(1) The naming changes (LLaMA -> Llama) to best fit for `transformers` naming rule, in both `LlamaForCausalLM` and `LlamaTokenizer`. This works perfectly for `transformers>=4.28.0`.
|
14 |
|
15 |
+
(2) The model checkpoints are saved in 3 shards (instead of 41 shards in [decapoda-research/Llama-13b-hf](https://huggingface.co/decapoda-research/Llama-13b-hf)). Less shards would accelerate loading speed from disk.
|
16 |
|
17 |
--
|
18 |
license: other
|