Hugging Face's logo

KIST-robot-intelligence
/
KONI-Llama3-8B-Instruct-20240729-GGUF-Quantization

Text Generation
GGUF
Korean
Inference Endpoints
conversational
Model card Files Community
4
kingkangkr commited on
Commit
ee8eed6
•
1 Parent(s): 74c05d8

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. KONI-Llama3-8B-Instruct-20240729-Q5_K_M.gguf +3 -0
  3. KONI-Llama3-8B-Instruct-20240729-Q5_K_S.gguf +3 -0
  4. KONI-Llama3-8B-Instruct-20240729-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -35,3 +35,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  KONI-Llama3-8B-Instruct-20240729-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
  KONI-Llama3-8B-Instruct-20240729-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  KONI-Llama3-8B-Instruct-20240729-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
  KONI-Llama3-8B-Instruct-20240729-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
38
+ KONI-Llama3-8B-Instruct-20240729-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ KONI-Llama3-8B-Instruct-20240729-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ KONI-Llama3-8B-Instruct-20240729-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
KONI-Llama3-8B-Instruct-20240729-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ecb34ca1de481e6015eea134b78749e0add6d8477d8a30d799d96ab0f6895d7
3
+ size 5732988192
KONI-Llama3-8B-Instruct-20240729-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3270f84747ecaeef8fdb4d86c6a05fe1682207d5ec70f239f753ed760040726
3
+ size 5599294752
KONI-Llama3-8B-Instruct-20240729-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:888e63c0ea89a56ed0e48b5ff8d7708ca2f22ccb33295859293c8347eb5198d1
3
+ size 6596007200