Hugging Face's logo

mantafloppy
/
WhiteRabbitNeo-33B-v1-GGUF

Transformers
GGUF
deepseek
Inference Endpoints
Model card Files Community
mantafloppy commited on
Commit
e60ea68
•
1 Parent(s): 143fb93

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -30,14 +30,15 @@ snapshot_download(repo_id=model_id, local_dir="whiterabbitneo-hf",
30
  ```
31
 
32
  brew install gh
 
33
  gh auth login
 
34
  gh pr checkout 3633
35
 
36
  python3 llama.cpp/convert.py whiterabbitneo-hf --outfile whiterabbitneo-33b-v1-q8_0.gguf --outtype q8_0 --padvocab
37
 
38
-
39
-
40
  python3 llama.cpp/convert.py whiterabbitneo-hf --outfile whiterabbitneo-f16.gguf --outtype f16 --padvocab
 
41
  llama.cpp/quantize whiterabbitneo-f16.gguf whiterabbitneo-q4_k.gguf q4_k
42
 
43
  ```
 
30
  ```
31
 
32
  brew install gh
33
+
34
  gh auth login
35
+
36
  gh pr checkout 3633
37
 
38
  python3 llama.cpp/convert.py whiterabbitneo-hf --outfile whiterabbitneo-33b-v1-q8_0.gguf --outtype q8_0 --padvocab
39
 
 
 
40
  python3 llama.cpp/convert.py whiterabbitneo-hf --outfile whiterabbitneo-f16.gguf --outtype f16 --padvocab
41
+
42
  llama.cpp/quantize whiterabbitneo-f16.gguf whiterabbitneo-q4_k.gguf q4_k
43
 
44
  ```