Accelerate with `enable_model_cpu_offload()`
#28
by
landmann
- opened
Whenever I run pipe.enable_model_cpu_offload(), I get that my version of accelerate should be 0.17. However, when I try to upgrade my accelerate to 0.17, I get the following
ERROR: No matching distribution found for accelerate~=0.17.0```
Its not pushed to pypi because its in development.
You can clone the repo from github, which is the 0.17.0.dev0
- git clone https://github.com/huggingface/accelerate.git
- cd accelerate
- pip install .
Be warned, as though diffusers say "Almost as fast inference as when the pipeline is used without any type of offloading." I did experience significant performance loss.