updated model card: removed token parameter from example
Browse files
README.md
CHANGED
@@ -72,7 +72,7 @@ print(tokenizer.batch_decode(outputs.detach().cpu().numpy()[:, input_ids.shape[1
|
|
72 |
If you are facing issues when loading the model, you can try to load it quantized:
|
73 |
|
74 |
```python
|
75 |
-
model = AutoModelForCausalLM.from_pretrained(model_id,
|
76 |
```
|
77 |
|
78 |
*Note*: The model loading strategy above requires the [*bitsandbytes*](https://pypi.org/project/bitsandbytes/) and [*accelerate*](https://pypi.org/project/accelerate/) libraries
|
|
|
72 |
If you are facing issues when loading the model, you can try to load it quantized:
|
73 |
|
74 |
```python
|
75 |
+
model = AutoModelForCausalLM.from_pretrained(model_id, load_in_8bit=True)
|
76 |
```
|
77 |
|
78 |
*Note*: The model loading strategy above requires the [*bitsandbytes*](https://pypi.org/project/bitsandbytes/) and [*accelerate*](https://pypi.org/project/accelerate/) libraries
|