luigi86
/

UnslopNemo-12B-v4_mlx-8bit

8-bit precision

Model card Files Files and versions Community

UnslopNemo-12B-v4_mlx-8bit / README.md

luigi86's picture

Upload folder using huggingface_hub

c4f2d06 verified 28 days ago

|

history blame contribute delete

240 Bytes

MLX Format and Quantizations for Unslop Nemo 12b v4

Quantized to 8-bit precision and tested using the mlx_lm utility on a 64GiB URAM M1 Max.

See original model for further details.