Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,9 @@ Open-Llama-2-Ko represents an advanced iteration of the Llama 2 model, featuring
|
|
26 |
|
27 |
The primary distinction between the Llama-2-Ko Series and Open-Llama-2-Ko lies in the dataset. Open-Llama-2-Ko exclusively utilizes publicly accessible Korean corpora, including sources such as [AI Hub](https://www.aihub.or.kr), [Modu Corpus, 모두의 말뭉치](https://corpus.korean.go.kr/), and [Korean Wikipedia](https://dumps.wikimedia.org/kowiki/).
|
28 |
|
29 |
-
As training was conducted solely with publicly available corpora, this model is open for unrestricted use by everyone, adhering to the MIT License
|
|
|
|
|
30 |
|
31 |
## Model Details
|
32 |
|
@@ -80,6 +82,10 @@ Total token count: Approximately 15 billion tokens (*using the expanded tokenize
|
|
80 |
| Llama-2 | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
|
81 |
| Llama-2-Ko | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
|
82 |
|
|
|
|
|
|
|
|
|
83 |
# **Model Benchmark**
|
84 |
|
85 |
## LM Eval Harness - Korean (polyglot branch)
|
|
|
26 |
|
27 |
The primary distinction between the Llama-2-Ko Series and Open-Llama-2-Ko lies in the dataset. Open-Llama-2-Ko exclusively utilizes publicly accessible Korean corpora, including sources such as [AI Hub](https://www.aihub.or.kr), [Modu Corpus, 모두의 말뭉치](https://corpus.korean.go.kr/), and [Korean Wikipedia](https://dumps.wikimedia.org/kowiki/).
|
28 |
|
29 |
+
As training was conducted solely with publicly available corpora, this model is open for unrestricted use by everyone, adhering to the MIT License*.
|
30 |
+
|
31 |
+
*MIT License under LLAMA 2 COMMUNITY LICENSE AGREEMENT
|
32 |
|
33 |
## Model Details
|
34 |
|
|
|
82 |
| Llama-2 | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
|
83 |
| Llama-2-Ko | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
|
84 |
|
85 |
+
# LICENSE
|
86 |
+
|
87 |
+
[MIT License under LLAMA 2 COMMUNITY LICENSE AGREEMENT](./LICENSE)
|
88 |
+
|
89 |
# **Model Benchmark**
|
90 |
|
91 |
## LM Eval Harness - Korean (polyglot branch)
|