Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 F16 0e96575 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 BF16 007a025 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q8_0 84f1f51 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q6_K d7e955a verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q5_K_M 86052a2 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q5_K_S 0f42df2 verified jartine commited on May 10