Hugging Face's logo

LPN64
/
LongCite-llama3.1-8b-GGUF

Text Generation
GGUF
imatrix
importance matrix
llama.cpp
Inference Endpoints
conversational
Model card Files Community
LPN64 commited on
Commit
de15183
•
1 Parent(s): 9090c82

Updated GGUFs with correct EOS token

Browse files
Files changed (6) hide show
  1. LongCite-llama3.1-8B-F16.gguf +1 -1
  2. LongCite-llama3.1-8B-IQ3_M.gguf +1 -1
  3. LongCite-llama3.1-8B-Q4_K_M.gguf +1 -1
  4. LongCite-llama3.1-8B-Q5_K_M.gguf +1 -1
  5. LongCite-llama3.1-8B-Q6_K.gguf +1 -1
  6. LongCite-llama3.1-8B-Q8_0.gguf +1 -1
LongCite-llama3.1-8B-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1be1490d97fea7db433e7b56a147c3f161ff5938a3cf8564353ac0e167e779c
3
  size 16068891104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7eef6314edca6fcc9814af950b98d0200854ae7ff9c0af79db758a292b8c4173
3
  size 16068891104
LongCite-llama3.1-8B-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7014fc5203895f8689474cf4a705d69ac86206c09d99187e4587083f8067a75
3
  size 3784823264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6486f9a8647e59d5710d9a9cbac7b6dcfc08f953554695dc1619df9d7c57c571
3
  size 3784823264
LongCite-llama3.1-8B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:05f52a216a31ff2bcfc4c32e06e976275cf42f081d96e0515163b3566073589d
3
  size 4920734176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad6590725c948bd24e05b32df1a1cc045854643610dce717fb75182d18517314
3
  size 4920734176
LongCite-llama3.1-8B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34d721b81fab3cce4e3da7201aaaa0d30529ce639f7a528457332884bfe9ce6a
3
  size 5732987360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab0143652ad84b986f6b336ad1da5815901487409cf1ddf5fa94c372db640d95
3
  size 5732987360
LongCite-llama3.1-8B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6ece5071e0e796a62c824f44032f7659d9bb7c30766d5fe7c4524eb238e8d5d
3
  size 6596006368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f454003b697629ab03c0006664bfb90b05d1e94b91118d9ee06a452e900aa0e
3
  size 6596006368
LongCite-llama3.1-8B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3fe81636e3fd3ea745ee2bb0566c8c3b67a0366fde61f7123df0fda407e0568
3
  size 8540770784
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9df035e6d0bef4f4308df21b772c081022fe5d25de1ea65475a0d43e453e0643
3
  size 8540770784