MLX quantized

#7
by shaowlnkngfu - opened

Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co/mlx-community/c4ai-command-r-plus-4bit

Sign up or log in to comment