PrunaAI
/

mattshumer-Llama-3-8B-16K-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mattshumer-Llama-3-8B-16K-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219

b59aa0d verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.29 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
config.json

869 Bytes

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
generation_config.json

142 Bytes

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
model-00001-of-00002.safetensors

4.68 GB
LFS

3e37323e9c02dd4aa02525ae5aaf47a00e30d8cf8926a0153f0cc97252f83602 7 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
model.safetensors.index.json

63.5 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
plots.png

452 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
results.json

1.49 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago
smash_config.json

1.01 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 7 months ago