File size: 4,893 Bytes
46a65ff 93ad14d d81f975 93ad14d 46a65ff 849e631 93ad14d 6ba3d40 59c80f8 b4d127e 93ad14d 1378a3d 552bcab 1378a3d 552bcab 69f8d9a 552bcab 69f8d9a 552bcab 69f8d9a 552bcab 69f8d9a 93ad14d 9a0dcfe 93ad14d d81f975 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 |
---
license: creativeml-openrail-m
language:
- en
tags:
- text-to-image
- midjourney
- stable-diffusion
- disco-diffusion
- art
inference: true
---
## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion
To apply the oil paint effect, begin the prompt with ((oil painting)). As a general rule, try using a dimension of 768x768 for any subject, 512x768 for portraits, and 1152x768 for landscapes.
To further improve the resolution and reduce noise in generated images, especially when using the model for img2img, use [Paint Journey VAE](./paint_journey_v2.vae.pt) in combination with [Checkpoint](./paint_journey_v2.ckpt).
As an example, a Automatic111's WebUI user can place both of these files in the `./stable-diffusion-webui/models/Stable-diffusion folder` to use them.
## Portrait Examples
## Landscape Examples
## Outerspace Examples
Prompts from top to bottom:
```
((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
Steps: 20, Sampler: Euler a, CFG scale: 7.5, Seed: 874776980, Size: 512x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), portrait of a handsome young man, small smile, athlete, ((beautiful eyes)), high resolution, uhd wallpaper
Negative prompt: low-res blurry fog mutated body naked ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
Steps: 20, Sampler: Euler a, CFG scale: 7.5, Seed: 2389251230, Size: 512x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), lighthouse near the sea, high resolution wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 353450032, Size: 768x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a lush valley with mountains in the background, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 65984537, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a forest, moon, dark, night, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4247689747, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), stunning landscape in an alien world, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 3693048118, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), the milky way, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 3904195208, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), the universe, high resolution wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 432451301, Size: 768x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a futuristic space station, lighting, sci-fi, dry paint, high resolution, uhd wallpaper
Negative prompt: low-res blurry ((fog)) watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
## WebUI Usage
```
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
```
Download [paint_journey_v2.ckpt](./paint_journey_v2.ckpt) to the `./stable-diffusion-webui/models/Stable-diffusion` folder. Run `webui-user.bat`.
## Diffusers Usage
```bash
pip install --upgrade diffusers
```
```python
from diffusers import StableDiffusionPipeline
import torch
pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
pipe = pipe.to("cuda")
prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd wallpaper"
image = pipe(prompt).images[0]
image.save("./result.png")
```
## Safety Checker
The official [stable diffusion safety checker](https://huggingface.co/CompVis/stable-diffusion-safety-checker) uses up 1.22GB VRAM. Recommend using [Google Safesearch Mini](https://huggingface.co/FredZhang7/google-safesearch-mini) (99MB) to save 1.12GB VRAM. |