nold
/

gemma-2b-GGUF

Inference Endpoints

Model card Files Files and versions Community

1 contributor

History: 2 commits

nold's picture

Upload folder using huggingface_hub (#1)

283de33 verified 6 months ago

.gitattributes

2.02 kB

Upload folder using huggingface_hub (#1) 6 months ago
README.md

21.6 kB

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_IQ3_S.gguf

1.29 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_IQ4_NL.gguf

1.56 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q2_K.gguf

1.16 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q3_K_M.gguf

1.38 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q4_K_M.gguf

1.63 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q5_K_M.gguf

1.84 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q6_K.gguf

2.06 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
gemma-2b_Q8_0.gguf

2.67 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
imatrix.dat

2.07 MB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
test.log

400 Bytes

Upload folder using huggingface_hub (#1) 6 months ago