README.md

metadata

{}

This repository contains the dataset of model weights and utility files for Interpreting the Weight Space of Customized Diffusion Models (aka weights2weights). The code can be found at https://github.com/snap-research/weights2weights.

Files for creating weights2weights Space

The files/ folder contains the files needed in our code here in order to conduct sampling, inversion, and editing in weights2weights space.

• files/V.pt
  • 99648x10000 dimensional tensor used to project or unproject LoRA weights onto a principal component representation in w2w space or to unproject back into the LoRA space.
• files/mean.pt
  • 99648 dimensional tensor of the mean for each parameter in the original LoRA space. Used for projection/unprojection.
• files/std.pt
  • 99648 dimensional tensor of the standard deviation for each parameter in the original LoRA space. Used for projection/unprojection.
• files/proj_1000pc.pt
  • 64974x1000 dimensional tensor where each row is a 1000-dimensional principal component projection for each identity-encoding model in our dataset of model weights.
• files/pinverse.pt
  • Precomputed pseudoinverse of 'proj.pt', used for obtaining the classifier weight space directions given labels.
• files/identity_df.pt
  • A pandas dataframe with binary attribute labels for each identity-encoding model. Used for getting labels for training linear classifiers.
• files/weight_dimensions.pt
  • A dictionary of the dimensionality for each LoRA module in the diffusion UNet. Used to save models in Diffusers pipeline format.
• files/adapter_config.json
  • A configuration file for LoRA. Used to save models in Diffusers pipeline format.

Datasets of Model Weights

The weights_datasetsfolder contains two datasets of model weights, one set containing LoRA weights encoding different human visual identities, and another for different dog breeds. We also provide metadata and files for handling these datasets.

• weights_datasets/identities/all_weights.pt
  • 64974x99648 dimensional tensor where each row is a 99648-dimensional vector of flattened LoRAs for each identity-encoding model.
• weights_datasets/identities/identity_df.pt
  • A pandas dataframe with binary attribute labels for each identity-encoding model.