Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
LPN64
/
LongCite-llama3.1-8b-GGUF
like
5
Text Generation
GGUF
THUDM/LongCite-45k
imatrix
importance matrix
llama.cpp
Inference Endpoints
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
1065fe8
LongCite-llama3.1-8b-GGUF
1 contributor
History:
15 commits
LPN64
Updated gguf with chat template metadatas
1065fe8
verified
about 2 months ago
.gitattributes
2.34 kB
Uploaded imat ggufs
2 months ago
LongCite-llama3.1-8B-F16.gguf
16.1 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-IQ3_M.gguf
3.78 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-Q4_K_M.gguf
4.92 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-Q5_K_M.gguf
5.73 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-Q6_K.gguf
6.6 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-Q8_0.gguf
8.54 GB
LFS
Updated GGUFs with correct EOS token
2 months ago
LongCite-llama3.1-8B-imat-IQ3_M.gguf
3.78 GB
LFS
Uploaded imat ggufs
2 months ago
LongCite-llama3.1-8B-imat-Q4_K_M.gguf
4.92 GB
LFS
Uploaded imat ggufs
2 months ago
LongCite-llama3.1-8B-imat-Q5_K_M.gguf
5.73 GB
LFS
Uploaded imat ggufs
2 months ago
LongCite-llama3.1-8B-imat-Q6_K.gguf
6.6 GB
LFS
Uploaded imat ggufs
2 months ago
LongCite-llama3.1-8B-imat-Q8_0.gguf
8.54 GB
LFS
Uploaded imat ggufs
2 months ago
README.md
7.94 kB
Update README.md
2 months ago
imatrix.dat
4.99 MB
LFS
Upload imatrix.dat
2 months ago
