Edit model card

Text-to-image finetuning - rcannizzaro/sd-dsprites-model

This pipeline was finetuned from runwayml/stable-diffusion-v1-5 on the osazuwa/dsprite-counterfactual dataset. Below are some example images generated with the finetuned pipeline using the following prompts: ['A medium-sized heart shape, tilted to the left, positioned towards the left side and near the top of the image.']:

val_imgs_grid

Pipeline usage

You can use the pipeline like so:

from diffusers import DiffusionPipeline
import torch

pipeline = DiffusionPipeline.from_pretrained("rcannizzaro/sd-dsprites-model", torch_dtype=torch.float16)
prompt = "A medium-sized heart shape, tilted to the left, positioned towards the left side and near the top of the image."
image = pipeline(prompt).images[0]
image.save("my_image.png")

Training info

These are the key hyperparameters used during training:

  • Epochs: 1
  • Learning rate: 1e-05
  • Batch size: 1
  • Gradient accumulation steps: 4
  • Image resolution: 64
  • Mixed-precision: fp16

More information on all the CLI arguments and the environment are available on your wandb run page.

Intended uses & limitations

How to use

# TODO: add an example code snippet for running this diffusion pipeline

Limitations and bias

[TODO: provide examples of latent issues and potential remediations]

Training details

[TODO: describe the data used to train the model]

Downloads last month
10
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for rcannizzaro/sd-dsprites-model

Finetuned
(598)
this model
Finetunes
2 models