darkproger
commited on
Commit
•
7963491
1
Parent(s):
96f9287
Update README.md
Browse files
README.md
CHANGED
@@ -47,7 +47,7 @@ pip install mlx-lm
|
|
47 |
from mlx_lm import load, generate
|
48 |
|
49 |
model, tokenizer = load("lang-uk/dragoman-4bit")
|
50 |
-
response = generate(model, tokenizer, prompt="
|
51 |
```
|
52 |
|
53 |
Or use from your shell:
|
|
|
47 |
from mlx_lm import load, generate
|
48 |
|
49 |
model, tokenizer = load("lang-uk/dragoman-4bit")
|
50 |
+
response = generate(model, tokenizer, prompt="[INST] who holds this neighborhood? [/INST]", verbose=True)
|
51 |
```
|
52 |
|
53 |
Or use from your shell:
|