llamafile
English
GGUF

Commit History

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_M
67ce9dd
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_S
e2f1aaa
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_M
ff3a419
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_S
a0949c7
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_L
690be13
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_M
5379f33
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_S
a1ff20e
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q2_K
952e76b
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_1
187a270
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_0
f1c934c
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_1
1052205
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_0
520fc7b
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F32
a26b598
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q5_K.llamafile
3dc5a8b
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q4_K.llamafile
c378db2
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q3_K.llamafile
5deafa7
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F16
08524de
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 BF16
8a7d4f5
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q8_0
6aee330
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q6_K
bab2baf
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_M
9115aff
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_S
2a816fc
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K
c931a5a
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_M
5da5761
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_S
dbafb0f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K
f07c622
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_L
7eb4de4
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_M
3f0260f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_S
a0485f9
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K
84b6af6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q2_K
ed8fdf9
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_1
b157c5f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_0
fabdf34
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_1
06bac9a
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_0
2c6bc5f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 F16
d99db16
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 BF16
679b4d6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q8_0
a84bff6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q6_K
7d1ffea
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q5_K_M
43ea77c
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q5_K_S
f7d76c1
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q5_K
9b89ed8
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q4_K_M
e7aba13
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q4_K_S
83786a5
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q4_K
9fa0931
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_L
d99d7d9
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_M
cfb2c3d
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_S
aa4bc7e
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K
7a6f2d0
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.f16.llamafile
f85c0b9
verified

jartine commited on