CLIP trained in SDXL VAE's latent space.
Installation
git clone [email protected]:wendlerc/latent_clip.git
- create environment using conda or virtualenv (I tested using python=3.11)
- install latent clip
cd latent_clip
make install
make install-training
Minimal usage https://github.com/wendlerc/latent_clip/blob/latent-clip/notebooks/Minimum%20Usage.ipynb