FredZhang7 commited on
Commit
f9d54ce
1 Parent(s): 5d7dfe8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -8,12 +8,17 @@ tags:
8
  - stable-diffusion
9
  - disco-diffusion
10
  - art
 
11
  inference: true
 
12
  ---
13
  ## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion
14
 
15
  To apply the oil paint effect, begin the prompt with **((oil painting))**. For starters, try using a dimension of 768x768 for any subject, 512x768 for portraits, and 1152x768 for landscapes.
16
 
 
 
 
17
  To further improve the resolution and reduce noise in generated images, especially when using the model for img2img, use [Paint Journey VAE](./paint_journey_v2.vae.pt) in combination with [Checkpoint](./paint_journey_v2.ckpt).
18
  As an example, a Automatic1111's WebUI user can add both of these files to the `./stable-diffusion-webui/models/Stable-diffusion` folder.
19
 
@@ -44,6 +49,9 @@ As an example, a Automatic1111's WebUI user can add both of these files to the `
44
 
45
  Prompts from top to bottom:
46
 
 
 
 
47
  ```
48
  ((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
49
  Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
@@ -90,6 +98,8 @@ Negative prompt: low-res blurry ((fog)) watermark
90
  Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
91
  ```
92
 
 
 
93
  ## Automatic1111's WebUI
94
  ```
95
  git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
@@ -107,7 +117,7 @@ import torch
107
  pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
108
  pipe = pipe.to("cuda")
109
 
110
- prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd wallpaper"
111
  image = pipe(prompt).images[0]
112
 
113
  image.save("./result.png")
 
8
  - stable-diffusion
9
  - disco-diffusion
10
  - art
11
+ - arxiv:2208.12242
12
  inference: true
13
+ library_name: diffusers
14
  ---
15
  ## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion
16
 
17
  To apply the oil paint effect, begin the prompt with **((oil painting))**. For starters, try using a dimension of 768x768 for any subject, 512x768 for portraits, and 1152x768 for landscapes.
18
 
19
+ Instead of solely fine-tuning its Unet, Paint Journey V2 focuses on fine-tuning its text encoder with a diverse range of prompts.
20
+ This allows for a seamless blend of the oil painting style into various other types of prompts, resulting in a more natural and dynamic output.
21
+
22
  To further improve the resolution and reduce noise in generated images, especially when using the model for img2img, use [Paint Journey VAE](./paint_journey_v2.vae.pt) in combination with [Checkpoint](./paint_journey_v2.ckpt).
23
  As an example, a Automatic1111's WebUI user can add both of these files to the `./stable-diffusion-webui/models/Stable-diffusion` folder.
24
 
 
49
 
50
  Prompts from top to bottom:
51
 
52
+ <details>
53
+ <summary> Click to expand </summary>
54
+
55
  ```
56
  ((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
57
  Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
 
98
  Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
99
  ```
100
 
101
+ </details>
102
+
103
  ## Automatic1111's WebUI
104
  ```
105
  git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
 
117
  pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
118
  pipe = pipe.to("cuda")
119
 
120
+ prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd, 4 k wallpaper"
121
  image = pipe(prompt).images[0]
122
 
123
  image.save("./result.png")