
# Chinese ControlNet Model (Canny)

## 简介 Brief Introduction

我们开源了一个中文 ControlNet 模型，该模型适配 diffusion 模型 `alibaba-pai/pai-diffusion-artist-large-zh`，您可以使用该模型控制 diffusion 模型生成的图像。

We release a Chinese ControlNet model, which works with diffusion model `alibaba-pai/pai-diffusion-artist-large-zh`. You can use this model to control the diffusion model generating images as you wish.

* Github: [EasyNLP](https://github.com/alibaba/EasyNLP)

## 使用 Usage

```python
from diffusers import StableDiffusionControlNetPipeline, ControlNetModel
from transformers import pipeline
from PIL import Image
import numpy as np
import cv2


def to_canny(image):
    low_threshold = 100
    high_threshold = 200
    image = np.array(image)
    image = cv2.Canny(image, low_threshold, high_threshold)
    image = image[:, :, None]
    image = np.concatenate([image, image, image], axis=2)
    image = Image.fromarray(image)
    return image


controlnet_id = "alibaba-pai/pai-diffusion-artist-large-zh-controlnet-canny"
controlnet = ControlNetModel.from_pretrained(controlnet_id)
model_id = "alibaba-pai/pai-diffusion-artist-large-zh"
pipe = StableDiffusionControlNetPipeline.from_pretrained(model_id, controlnet=controlnet)
pipe = pipe.to("cuda")

image = Image.open("image.png")
controlnet_image = to_canny(image)
prompt = "白色的小鸟"
image = pipe(prompt, controlnet_image).images[0]

controlnet_image.save("image_canny.png")
image.save("image_canny_output.png")
```

## 样例 Example

Prompt: "白色的小鸟"

|原图|Canny 图|生成图|
|-|-|-|
|![](image.png)|![](image_canny.png)|![](image_canny_output.png)|

## 使用须知 Notice for Use

使用上述模型需遵守[AIGC模型开源特别条款](https://terms.alicdn.com/legal-agreement/terms/common_platform_service/20230505180457947/20230505180457947.html)。

If you want to use this model, please read this [document](https://terms.alicdn.com/legal-agreement/terms/common_platform_service/20230505180457947/20230505180457947.html) carefully and abide by the terms.

{"license": "apache-2.0", "tags": ["pytorch", "diffusers", "text-to-image"]}
diffusers pytorch text-to-image license:apache-2.0 diffusers:ControlNetModel region:us
TAGS
#diffusers #pytorch #text-to-image #license-apache-2.0 #diffusers-ControlNetModel #region-us 

Chinese ControlNet Model (Canny)
================================


简介 Brief Introduction
---------------------


我们开源了一个中文 ControlNet 模型，该模型适配 diffusion 模型 'alibaba-pai/pai-diffusion-artist-large-zh'，您可以使用该模型控制 diffusion 模型生成的图像。


We release a Chinese ControlNet model, which works with diffusion model 'alibaba-pai/pai-diffusion-artist-large-zh'. You can use this model to control the diffusion model generating images as you wish.


* Github: EasyNLP


使用 Usage
--------


样例 Example
----------


Prompt: "白色的小鸟"


原图: ![](URL), Canny 图: ![](image_canny.png), 生成图: ![](image_canny_output.png)


使用须知 Notice for Use
-------------------


使用上述模型需遵守AIGC模型开源特别条款。


If you want to use this model, please read this document carefully and abide by the terms.



TAGS
#diffusers #pytorch #text-to-image #license-apache-2.0 #diffusers-ControlNetModel #region-us 
