Vivien Chappelier commited on
Commit
2716b73
1 Parent(s): 241454a

detection + robustness info

Browse files
Files changed (1) hide show
  1. README.md +63 -1
README.md CHANGED
@@ -24,4 +24,66 @@ vae = AutoencoderKL.from_pretrained("imatag/stable-signature-bzh-sdxl-vae-strong
24
  pipe = StableDiffusionXLPipeline.from_pretrained(model, vae=vae)
25
  ```
26
 
27
- For more information, please have a look at [the official demo](https://huggingface.co/spaces/imatag/stable-signature-bzh)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
  pipe = StableDiffusionXLPipeline.from_pretrained(model, vae=vae)
25
  ```
26
 
27
+ For more information, please have a look at [the official demo](https://huggingface.co/spaces/imatag/stable-signature-bzh)
28
+
29
+ ## Decoder Finetuning
30
+
31
+ This model was finetuned from the original StableDiffusion-XL autoencoder with the additional objective of including a strong invisible watermark, following the procedure of [StableSignature](https://ai.meta.com/blog/stable-signature-watermarking-generative-ai/). This watermark is detectable by [IMATAG](https://www.imatag.com/)'s demo BZH decoder, available via API.
32
+
33
+ ## Detecting the watermark
34
+
35
+ For security reasons we cannot release the weights of the detector. Instead, you may check for the presence of a watermark with the [detect_api.py](https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/detect_api.py) script like this:
36
+ ```shell
37
+ python detect_api.py test.png
38
+ ```
39
+
40
+ ### Visual
41
+ _Visualization of watermark impact on 512x512 images from the COCO2017 validation dataset prompts with SDXL-turbo._
42
+
43
+ <p align="center">
44
+ <br>
45
+ <b>
46
+ 512x512: original (left), watermarked (middle), difference (right)</b>
47
+ </p>
48
+
49
+ <p align="center">
50
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0001.png />
51
+ </p>
52
+
53
+ <p align="center">
54
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0003.png />
55
+ </p>
56
+
57
+ <p align="center">
58
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0004.png />
59
+ </p>
60
+
61
+ <p align="center">
62
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0005.png />
63
+ </p>
64
+
65
+ <p align="center">
66
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0006.png />
67
+ </p>
68
+
69
+ ### Robustness
70
+
71
+ The watermark is robust to most editorial changes to an image, such as cropping, changing brightness or contrast, resizing or JPEG compression:
72
+
73
+ <p align="center">
74
+ <br>
75
+ <b>
76
+ from left to right: original, watermarked, difference, 'crop 50% + brigthen 50% + jpeg 80%' attack, 'downscale 2x + crop 50% + brigthen 50% + jpeg 50%' attack</b>
77
+ </p>
78
+
79
+ <p align="center">
80
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/0000.png />
81
+ </p>
82
+
83
+ The Receiver Operating Characteristic curve shows its performance under no modification and when modified by the two scenarios illustrated above:
84
+ <p align="center">
85
+ <img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/strong/roc.png />
86
+ </p>
87
+
88
+ More details available in our [announcement](https://www.imatag.com/blog/unlocking-the-future-of-content-authentication-imatags-breakthrough-in-ai-generated-image-watermarking) and our lab's [blog post](https://imatag-lab.medium.com/stable-signature-meets-bzh-53ad0ba13691).
89
+ For watermarked models with a different key, support for payload, other perceptual compromises, robustness to other attacks, or faster detection, please [contact IMATAG](https://pages.imatag.com/contact-us-imatag).