Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mychen76
/
Llama-3.1-8B-bonito-v1-awq
like
0
Safetensors
llama
4-bit precision
awq
arxiv:
2402.18334
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Use this model
main
Llama-3.1-8B-bonito-v1-awq
1 contributor
History:
11 commits
mychen76
Update README.md
4c9cacd
verified
12 days ago
.gitattributes
1.52 kB
initial commit
13 days ago
AWQ_Inference-Bonito.ipynb
48.8 kB
Upload AWQ_Inference-Bonito.ipynb
12 days ago
README.md
7.81 kB
Update README.md
12 days ago
config.json
1.15 kB
inital
12 days ago
generation_config.json
180 Bytes
inital
12 days ago
model-00001-of-00002.safetensors
4.68 GB
LFS
inital
12 days ago
model-00002-of-00002.safetensors
1.05 GB
LFS
inital
12 days ago
model.safetensors.index.json
63.5 kB
inital
12 days ago
requirements_bonito.txt
7.54 kB
Upload requirements_bonito.txt
12 days ago
special_tokens_map.json
439 Bytes
inital
12 days ago
tokenizer.json
9.09 MB
inital
12 days ago
tokenizer_config.json
50.7 kB
inital
12 days ago