xxx777xxxASD
commited on
Commit
•
079fa7f
1
Parent(s):
31e8a6d
Update README.md
Browse files
README.md
CHANGED
@@ -54,7 +54,7 @@ experts:
|
|
54 |
|
55 |
## Usage
|
56 |
|
57 |
-
It seems like 1.71 koboldcpp can't run GGUFs of llama-3.1 MoE models yet, or perhaps im just dumb and messed something up
|
58 |
If anyone has simmilar problem - run the model directly from llama.cpp, here's simple [open source GUI(Windows)](https://huggingface.co/xxx777xxxASD/LlamaCpp-Server-Ui) you can use if the console is your worst enemy
|
59 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/sTM3GUVMucM_AnIk8iG7H.png)
|
60 |
|
|
|
54 |
|
55 |
## Usage
|
56 |
|
57 |
+
It seems like 1.71 koboldcpp can't run GGUFs of llama-3.1 MoE models yet, or perhaps im just dumb and messed something up.
|
58 |
If anyone has simmilar problem - run the model directly from llama.cpp, here's simple [open source GUI(Windows)](https://huggingface.co/xxx777xxxASD/LlamaCpp-Server-Ui) you can use if the console is your worst enemy
|
59 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/sTM3GUVMucM_AnIk8iG7H.png)
|
60 |
|