HuggingFaceTB
/

SmolLM2-1.7B-Instruct-Q8-mlx

Text Generation

Transformers.js

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

reach-vb HF staff commited on 16 days ago

Commit

2bb0b4c

•

1 Parent(s): 1a7baec

Update README.md (#1)

- Update README.md (2935669843e08e8b27bd093d0eb1e29e4f3b9eb1)

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -13,9 +13,9 @@ tags:
 base_model: HuggingFaceTB/SmolLM2-1.7B-Instruct
 ---
-# reach-vb/SmolLM2-1.7B-Instruct-Q8-mlx
-The Model [reach-vb/SmolLM2-1.7B-Instruct-Q8-mlx](https://huggingface.co/reach-vb/SmolLM2-1.7B-Instruct-Q8-mlx) was converted to MLX format from [HuggingFaceTB/SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) using mlx-lm version **0.19.2**.
 ## Use with mlx
@@ -26,7 +26,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("reach-vb/SmolLM2-1.7B-Instruct-Q8-mlx")
 prompt="hello"

 base_model: HuggingFaceTB/SmolLM2-1.7B-Instruct
 ---
+# HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx
+The Model [HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx) was converted to MLX format from [HuggingFaceTB/SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) using mlx-lm version **0.19.2**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx")
 prompt="hello"