ThomasBaruzier
/

Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-GGUF

Commit History

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf

9816e0a
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ4_NL.gguf

17b00a5
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q4_0.gguf

f16ca9e
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf

9f43d20
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf

97577aa
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf

10d431b
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ3_M.gguf

9b39def
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ3_S.gguf

0e6e7f2
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf

69da085
verified

ThomasBaruzier commited on Jul 31

Update README.md

d53b03d
verified

ThomasBaruzier commited on Jul 31

Update README.md

15e8c0c
verified

ThomasBaruzier commited on Jul 31

Update README.md

cffc50f
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XS.gguf

ffabec7
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XXS.gguf

8412f7a
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q2_K.gguf

0b777d9
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q2_K_S.gguf

9afc4c8
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ2_M.gguf

85f5e31
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ2_S.gguf

04ec6f5
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XS.gguf

e4b2fbe
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XXS.gguf

2b8c290
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ1_M.gguf

1f8a57a
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ1_S.gguf

4731186
verified

ThomasBaruzier commited on Jul 31

Upload imatrix.dat

9973882
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_4_8.gguf

0c6552a
verified

ThomasBaruzier commited on Jul 30

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_8_8.gguf

c8f2b6a
verified

ThomasBaruzier commited on Jul 30

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_4_4.gguf

bb348c8
verified

ThomasBaruzier commited on Jul 30

Update README.md

ab75ef7
verified

ThomasBaruzier commited on Jul 29

Update README.md

f01d1d6
verified

ThomasBaruzier commited on Jul 28

Update README.md

c79a914
verified

ThomasBaruzier commited on Jul 28

Upload Meta-Llama-3.1-8B-Instruct-F16.gguf

269c264
verified

ThomasBaruzier commited on Jul 27

Update README.md

4d58a94
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q8_0.gguf

2610633
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q6_K.gguf

9104aa4
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_1.gguf

410153e
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

898b243
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_0.gguf

ab1abb5
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf

f61af01
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_1.gguf

c2f3de4
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf

ff60c9c
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf

5cddd0f
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ4_NL.gguf

0850a6c
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_0.gguf

057ffac
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf

d9cf4cc
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf

9a4f6c4
verified

ThomasBaruzier commited on Jul 27

Delete ggml-model-IQ1_S.gguf

daa2f5b
verified

ThomasBaruzier commited on Jul 27

Delete ggml-model-IQ1_M.gguf

18932f2
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf

cd25e5e
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_M.gguf

5694c91
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_S.gguf

c541396
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf

701b807
verified

ThomasBaruzier commited on Jul 27