AI-Engine
/

Meta-Llama-3.1-8B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-GGUF

1 contributor

History: 36 commits

AI-Engine's picture

Upload Meta-Llama-3.1-8B-Instruct-imatrix-F32.gguf with huggingface_hub

70f0483 verified about 2 months ago

.gitattributes

2.65 kB

Upload Meta-Llama-3.1-8B-Instruct-imatrix-F32.gguf with huggingface_hub about 2 months ago
LICENSE

7.63 kB

Upload 2 files 4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix-F32.gguf

32.1 GB
LFS

Upload Meta-Llama-3.1-8B-Instruct-imatrix-F32.gguf with huggingface_hub about 2 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf

3.18 GB
LFS

Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf with huggingface_hub about 2 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf

5.73 GB
LFS

Upload Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf with huggingface_hub about 2 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf

8.54 GB
LFS

Upload Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf with huggingface_hub about 2 months ago
README.md

777 Bytes

Update README.md about 2 months ago
USE_POLICY.md

4.69 kB

Upload 2 files 4 months ago