|
--- |
|
license: creativeml-openrail-m |
|
language: |
|
- en |
|
library_name: diffusers |
|
pipeline_tag: text-to-image |
|
tags: |
|
- stable-diffusion |
|
- stable-diffusion-diffusers |
|
- text-to-image |
|
inference: |
|
parameters: |
|
num_inference_steps: 50 |
|
guidance_scale: 5.0 |
|
eta: 1.0 |
|
widget: |
|
- text: "lion" |
|
example_title: lion |
|
- text: "butterfly" |
|
example_title: butterfly |
|
- text: "dolphin" |
|
example_title: dolphin |
|
--- |
|
|
|
# ddpo-aesthetic |
|
|
|
This model was finetuned from [Stable Diffusion v1-4](https:/CompVis/stable-diffusion-v1-4) using [DDPO](https://arxiv.org/abs/2305.13301) and a reward function based on the [LAION aesthetic predictor](https://laion.ai/blog/laion-aesthetics/). See [the project website](https://rl-diffusion.github.io/) for more details. |
|
|
|
The model was finetuned for 40 iterations with a batch size of 256 samples per iteration. It was only prompted with the following list of 45 common animals during finetuning, so try those for the best results. However, we also observed limited generalization to other prompts. |
|
|
|
Prompts: |
|
- cat |
|
- dog |
|
- horse |
|
- monkey |
|
- rabbit |
|
- zebra |
|
- spider |
|
- bird |
|
- sheep |
|
- deer |
|
- cow |
|
- goat |
|
- lion |
|
- tiger |
|
- bear |
|
- raccoon |
|
- fox |
|
- wolf |
|
- lizard |
|
- beetle |
|
- ant |
|
- butterfly |
|
- fish |
|
- shark |
|
- whale |
|
- dolphin |
|
- squirrel |
|
- mouse |
|
- rat |
|
- snake |
|
- turtle |
|
- frog |
|
- chicken |
|
- duck |
|
- goose |
|
- bee |
|
- pig |
|
- turkey |
|
- fly |
|
- llama |
|
- camel |
|
- bat |
|
- gorilla |
|
- hedgehog |
|
- kangaroo |
