KIST-robot-intelligence
/

KONI-Llama3-8B-Instruct-20240729-GGUF-Quantization

Text Generation

Inference Endpoints

Model card Files Files and versions Community

KONI-Llama3-8B-Instruct-20240729-GGUF-Quantization

2 contributors

History: 6 commits

kingkangkr's picture

Upload 4 files

be536f6 verified 3 months ago

.gitattributes

2.56 kB

Upload 4 files 3 months ago
KONI-Llama3-8B-Instruct-20240729-F16.gguf

16.1 GB
LFS

Upload 2 files (#1) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q2_k.gguf

3.18 GB
LFS

Upload 4 files 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q3_K_L.gguf

4.32 GB
LFS

Upload 4 files 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q3_K_M.gguf

4.02 GB
LFS

Upload 4 files 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q3_K_S.gguf

3.66 GB
LFS

Upload 4 files 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q4_0.gguf

4.66 GB
LFS

Upload 4 files (#3) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q4_1.gguf

5.13 GB
LFS

Upload 4 files (#3) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q4_K_M.gguf

4.92 GB
LFS

Upload 4 files (#3) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q4_K_S.gguf

4.69 GB
LFS

Upload 4 files (#3) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q5_K_M.gguf

5.73 GB
LFS

Upload 3 files (#2) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q5_K_S.gguf

5.6 GB
LFS

Upload 3 files (#2) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q6_K.gguf

6.6 GB
LFS

Upload 3 files (#2) 3 months ago
KONI-Llama3-8B-Instruct-20240729-Q8_0.gguf

8.54 GB
LFS

Upload 2 files (#1) 3 months ago
README.md

10.6 kB

Create README.md 3 months ago