Hugging Face's logo

sszymczyk
/
snowflake-arctic-instruct-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
sszymczyk commited on
Commit
5d07541
•
1 Parent(s): a1eeb6d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -3,5 +3,7 @@ license: apache-2.0
3
  ---
4
  Quantized version of https://huggingface.co/Snowflake/snowflake-arctic-instruct
5
 
6
- Branched llama.cpp with Snowflake Arctic support: https://github.com/fairydreaming/llama.cpp/tree/snowflake-arctic
 
 
7
 
 
3
  ---
4
  Quantized version of https://huggingface.co/Snowflake/snowflake-arctic-instruct
5
 
6
+ If you downloaded older quants (with no folders) you have to redownload.
7
+
8
+ There is no support for this in mainline llama.cpp yet. You have to use snowflake-arctic branch: https://github.com/fairydreaming/llama.cpp/tree/snowflake-arctic
9