Hugging Face's logo

misdelivery
/
Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1-Q4_K_S-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
misdelivery commited on
Commit
0e40161
•
1 Parent(s): 20322d9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -2,4 +2,5 @@
2
  license: llama3.1
3
  ---
4
 
5
- [misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1](https://huggingface.co/misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1)のQ4_K_S GGUFです。
 
 
2
  license: llama3.1
3
  ---
4
 
5
+ [misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1](https://huggingface.co/misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1)のQ4_K_S GGUF（テスト用）です。
6
+ imatrix量子化をするとさらに性能が上がると思います。