NikolayKozloff
commited on
Commit
•
9938649
1
Parent(s):
1f2d144
Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,7 @@ license: cc-by-nc-4.0
|
|
6 |
tags:
|
7 |
- llama-cpp
|
8 |
- gguf-my-repo
|
|
|
9 |
---
|
10 |
|
11 |
# NikolayKozloff/RoLlama3-8b-Instruct-Q5_0-GGUF
|
@@ -50,4 +51,4 @@ Step 3: Run inference through the main binary.
|
|
50 |
or
|
51 |
```
|
52 |
./llama-server --hf-repo NikolayKozloff/RoLlama3-8b-Instruct-Q5_0-GGUF --hf-file rollama3-8b-instruct-q5_0.gguf -c 2048
|
53 |
-
```
|
|
|
6 |
tags:
|
7 |
- llama-cpp
|
8 |
- gguf-my-repo
|
9 |
+
- text-generation-inference
|
10 |
---
|
11 |
|
12 |
# NikolayKozloff/RoLlama3-8b-Instruct-Q5_0-GGUF
|
|
|
51 |
or
|
52 |
```
|
53 |
./llama-server --hf-repo NikolayKozloff/RoLlama3-8b-Instruct-Q5_0-GGUF --hf-file rollama3-8b-instruct-q5_0.gguf -c 2048
|
54 |
+
```
|