NikolayKozloff
commited on
Commit
•
275f24f
1
Parent(s):
24d8f2a
Update README.md
Browse files
README.md
CHANGED
@@ -7,6 +7,7 @@ license: openrail
|
|
7 |
tags:
|
8 |
- llama-cpp
|
9 |
- gguf-my-repo
|
|
|
10 |
---
|
11 |
|
12 |
# NikolayKozloff/sqt5-xl-Q8_0-GGUF
|
@@ -51,4 +52,4 @@ Step 3: Run inference through the main binary.
|
|
51 |
or
|
52 |
```
|
53 |
./llama-server --hf-repo NikolayKozloff/sqt5-xl-Q8_0-GGUF --hf-file sqt5-xl-q8_0.gguf -c 2048
|
54 |
-
```
|
|
|
7 |
tags:
|
8 |
- llama-cpp
|
9 |
- gguf-my-repo
|
10 |
+
- text-generation-inference
|
11 |
---
|
12 |
|
13 |
# NikolayKozloff/sqt5-xl-Q8_0-GGUF
|
|
|
52 |
or
|
53 |
```
|
54 |
./llama-server --hf-repo NikolayKozloff/sqt5-xl-Q8_0-GGUF --hf-file sqt5-xl-q8_0.gguf -c 2048
|
55 |
+
```
|