SalmanFaroz
commited on
Commit
•
fe08217
1
Parent(s):
317fdf2
Update README.md
Browse filesValueError: `.to` is not supported for `4-bit` or `8-bit` bitsandbytes models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct `dtype`.
README.md
CHANGED
@@ -339,7 +339,7 @@ model = AutoModelForVision2Seq.from_pretrained(
|
|
339 |
"HuggingFaceM4/idefics2-8b",
|
340 |
+ torch_dtype=torch.float16,
|
341 |
+ quantization_config=quantization_config,
|
342 |
-
)
|
343 |
```
|
344 |
|
345 |
</details>
|
|
|
339 |
"HuggingFaceM4/idefics2-8b",
|
340 |
+ torch_dtype=torch.float16,
|
341 |
+ quantization_config=quantization_config,
|
342 |
+
)
|
343 |
```
|
344 |
|
345 |
</details>
|