Problem with configuring offload_folder
#12
by
ManneDK
- opened
I have a problem, maybe someone can help me:
ValueError: The current device_map had weights offloaded to the disk. Please provide an offload_folder for them. Alternatively, make
sure you have safetensors installed if the model you are using offers the weights in this format.
I have safetensors installed:
(base) manne@ManneMint:~/AI/text-generation-webui$ pip show safetensors
Name: safetensors
Version: 0.4.2
Summary:
Home-page:
Author:
Author-email: Nicolas Patry [email protected]
License:
Location: /home/manne/.local/lib/python3.10/site-packages
Requires:
Required-by: timm, transformers
How do i set an offload_folder? i have tryed:
offload_folder = "~/AI/text-generation-webui/offload",
And it doesn't work for me, anyone there can help?