PrunaAI
/

McGill-NLP-Llama-3-8B-Web-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

McGill-NLP-Llama-3-8B-Web-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc

887b335 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.36 kB

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
config.json

867 Bytes

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
generation_config.json

164 Bytes

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
model-00001-of-00002.safetensors

4.68 GB
LFS

3da9ead840dec3a4475c63dd639a286917bf89bc63a289e6bcec83c742cf74a4 7 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
model.safetensors.index.json

63.5 kB

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
plots.png

589 kB

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
results.json

1.74 kB

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago
smash_config.json

1.01 kB

ea559429621e1f6fad2eb6788686670127b701c0143132670c1d8adc6a1860fc 7 months ago