limhyeonseok
commited on
Commit
โข
e07d0d3
1
Parent(s):
14344b4
Update README.md
Browse files
README.md
CHANGED
@@ -86,34 +86,6 @@ Refer to the [original model card](https://huggingface.co/MLP-KTLim/llama-3-Kore
|
|
86 |
## Example code
|
87 |
|
88 |
|
89 |
-
## Use with llama.cpp
|
90 |
-
|
91 |
-
Install llama.cpp through brew.
|
92 |
-
|
93 |
-
```bash
|
94 |
-
brew install ggerganov/ggerganov/llama.cpp
|
95 |
-
```
|
96 |
-
Invoke the llama.cpp server or the CLI.
|
97 |
-
|
98 |
-
CLI:
|
99 |
-
|
100 |
-
```bash
|
101 |
-
llama-cli --hf-repo Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M --model bllossom_llama3_70b.Q4_K_M.gguf -p "์์ธ๊ณผํ๊ธฐ์ ๋ํ๊ต ์๊ฒฝํ ๊ต์๋ ์ด๋ค์ฐ๊ตฌ๋ฅผํ๋?"
|
102 |
-
```
|
103 |
-
|
104 |
-
Server:
|
105 |
-
|
106 |
-
```bash
|
107 |
-
llama-server --hf-repo Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M --model bllossom_llama3_70b.Q4_K_M.gguf -c 2048
|
108 |
-
```
|
109 |
-
|
110 |
-
Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
|
111 |
-
|
112 |
-
```
|
113 |
-
git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m bllossom_llama3_70b.Q4_K_M.gguf -n 128
|
114 |
-
```
|
115 |
-
|
116 |
-
|
117 |
|
118 |
|
119 |
## Citation
|
|
|
86 |
## Example code
|
87 |
|
88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
89 |
|
90 |
|
91 |
## Citation
|