Update README.md
Browse files
README.md
CHANGED
@@ -40,18 +40,17 @@ pipeline_tag: text-generation
|
|
40 |
|
41 |
|
42 |
AI ์ ๋น
๋ฐ์ดํฐ ๋ถ์ ์ ๋ฌธ ๊ธฐ์
์ธ Linkbricks์ ๋ฐ์ดํฐ์ฌ์ด์ธํฐ์คํธ์ธ ์ง์ค์ฑ(Saxo) ์ด์ฌ๊ฐ <br>
|
43 |
-
Hermes-3-Llama-3.1-8B ๋ฒ ์ด์ค๋ชจ๋ธ์ ์ฌ์ฉํด์ H100-80G 8๊ฐ๋ฅผ ํตํด CPT(Continue-Pretraining) ํ ํ๊ธ ์ธ์ด
|
44 |
-
๋ค์ํ ํ
์คํฌ๋ณ ํ๊ตญ์ด-์ค๊ตญ์ด-์์ด-์ผ๋ณธ์ด ๊ต์ฐจ ํ์ต ๋ฐ์ดํฐ์ ์ํ ๋ฐ ๋
ผ๋ฆฌํ๋จ ๋ฐ์ดํฐ๋ฅผ ํตํ์ฌ ํ์ค์ผ์ ์ธ์ด ๊ต์ฐจ ์ฆ๊ฐ ์ฒ๋ฆฌ์ ๋ณต์กํ ๋
ผ๋ฆฌ ๋ฌธ์ ์ญ์ ๋์ ๊ฐ๋ฅํ๋๋ก ํ๋ จํ ๋ชจ๋ธ์ด๋ค.<br>
|
45 |
-ํ ํฌ๋์ด์ ๋ ๋จ์ด ํ์ฅ ์์ด ๋ฒ ์ด์ค ๋ชจ๋ธ ๊ทธ๋๋ก ์ฌ์ฉ<br>
|
46 |
-๊ณ ๊ฐ ๋ฆฌ๋ทฐ๋ ์์
ํฌ์คํ
๊ณ ์ฐจ์ ๋ถ์ ๋ฐ ์ฝ๋ฉ๊ณผ ์๋ฌธ, ์ํ, ๋
ผ๋ฆฌํ๋จ ๋ฑ์ด ๊ฐํ๋ ๋ชจ๋ธ<br>
|
47 |
-128k-Context Window<br>
|
48 |
-ํ๊ธ Functioncall ๋ฐ Tool Calling ์ง์ <br>
|
49 |
-
-Deepspeed Stage=3, rslora ๋ฐ BAdam Layer Mode ์ฌ์ฉ <br>
|
50 |
-
-ollama run benedict/linkbricks-llama3.1-korean:8b
|
51 |
|
52 |
Finetuned by Mr. Yunsung Ji (Saxo), a data scientist at Linkbricks, a company specializing in AI and big data analytics <br>
|
53 |
CPT(Continue-Pretraining) model based on Hermes-3-Llama-3.1-8B through 8 H100-80Gs as a Korean language model <br>
|
54 |
-
It is a model that has been trained to handle Korean-Chinese-English-Japanese cross-training data and logic judgment data for various tasks to enable cross-fertilization processing and complex Korean logic & math problems. <br>
|
55 |
-Tokenizer uses the base model without word expansion<br>
|
56 |
-Models enhanced with high-dimensional analysis of customer reviews and social posts, as well as coding, writing, amth and decision making<br>
|
57 |
-128k-Context Window<br>
|
|
|
40 |
|
41 |
|
42 |
AI ์ ๋น
๋ฐ์ดํฐ ๋ถ์ ์ ๋ฌธ ๊ธฐ์
์ธ Linkbricks์ ๋ฐ์ดํฐ์ฌ์ด์ธํฐ์คํธ์ธ ์ง์ค์ฑ(Saxo) ์ด์ฌ๊ฐ <br>
|
43 |
+
Hermes-3-Llama-3.1-8B ๋ฒ ์ด์ค๋ชจ๋ธ์ ์ฌ์ฉํด์ H100-80G 8๊ฐ๋ฅผ ํตํด CPT(Continue-Pretraining) ํ ํ๊ธ ์ธ์ด ๋ชจ๋ธ<br>
|
44 |
+
์ฒ๋ง๊ฑด์ ํ๊ธ ๋ด์ค ์ฝํผ์ค๋ฅผ ๊ธฐ์ค์ผ๋ก ๋ค์ํ ํ
์คํฌ๋ณ ํ๊ตญ์ด-์ค๊ตญ์ด-์์ด-์ผ๋ณธ์ด ๊ต์ฐจ ํ์ต ๋ฐ์ดํฐ์ ์ํ ๋ฐ ๋
ผ๋ฆฌํ๋จ ๋ฐ์ดํฐ๋ฅผ ํตํ์ฌ ํ์ค์ผ์ ์ธ์ด ๊ต์ฐจ ์ฆ๊ฐ ์ฒ๋ฆฌ์ ๋ณต์กํ ๋
ผ๋ฆฌ ๋ฌธ์ ์ญ์ ๋์ ๊ฐ๋ฅํ๋๋ก ํ๋ จํ ๋ชจ๋ธ์ด๋ค.<br>
|
45 |
-ํ ํฌ๋์ด์ ๋ ๋จ์ด ํ์ฅ ์์ด ๋ฒ ์ด์ค ๋ชจ๋ธ ๊ทธ๋๋ก ์ฌ์ฉ<br>
|
46 |
-๊ณ ๊ฐ ๋ฆฌ๋ทฐ๋ ์์
ํฌ์คํ
๊ณ ์ฐจ์ ๋ถ์ ๋ฐ ์ฝ๋ฉ๊ณผ ์๋ฌธ, ์ํ, ๋
ผ๋ฆฌํ๋จ ๋ฑ์ด ๊ฐํ๋ ๋ชจ๋ธ<br>
|
47 |
-128k-Context Window<br>
|
48 |
-ํ๊ธ Functioncall ๋ฐ Tool Calling ์ง์ <br>
|
49 |
+
-Deepspeed Stage=3, rslora ๋ฐ BAdam Layer Mode ์ฌ์ฉ <br><br><br>
|
|
|
50 |
|
51 |
Finetuned by Mr. Yunsung Ji (Saxo), a data scientist at Linkbricks, a company specializing in AI and big data analytics <br>
|
52 |
CPT(Continue-Pretraining) model based on Hermes-3-Llama-3.1-8B through 8 H100-80Gs as a Korean language model <br>
|
53 |
+
It is a model that has been trained to handle Korean-Chinese-English-Japanese cross-training data and 10M korean news corpus and logic judgment data for various tasks to enable cross-fertilization processing and complex Korean logic & math problems. <br>
|
54 |
-Tokenizer uses the base model without word expansion<br>
|
55 |
-Models enhanced with high-dimensional analysis of customer reviews and social posts, as well as coding, writing, amth and decision making<br>
|
56 |
-128k-Context Window<br>
|