MLX quantized
#7
by
shaowlnkngfu
- opened
Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co/mlx-community/c4ai-command-r-plus-4bit
Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co/mlx-community/c4ai-command-r-plus-4bit