hugging-quants
/

Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-AWQ-INT4

6 contributors

History: 13 commits

alvarobartt's picture

alvarobartt HF staff

Create LICENSE

ce218d1 verified 4 months ago

.gitattributes

1.52 kB

initial commit 4 months ago
LICENSE

7.63 kB

Create LICENSE 4 months ago
README.md

6.45 kB

Create README.md 4 months ago
config.json

947 Bytes

Add files using large-upload tool 4 months ago
generation_config.json

189 Bytes

Add files using large-upload tool 4 months ago
model-00001-of-00009.safetensors

4.97 GB
LFS

Add files using large-upload tool 4 months ago
model-00002-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00003-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00004-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00005-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00006-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00007-of-00009.safetensors

4.89 GB
LFS

Add files using large-upload tool 4 months ago
model-00008-of-00009.safetensors

3.36 GB
LFS

Add files using large-upload tool 4 months ago
model-00009-of-00009.safetensors

2.1 GB
LFS

Add files using large-upload tool 4 months ago
model.safetensors.index.json

159 kB

Add files using large-upload tool 4 months ago
special_tokens_map.json

296 Bytes

Add files using large-upload tool 4 months ago
tokenizer.json

9.08 MB

Add files using large-upload tool 4 months ago
tokenizer_config.json

50.9 kB

Add files using large-upload tool 4 months ago