Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
@@ -84,46 +84,27 @@ def process_img (image, prompt):
|
|
84 |
|
85 |
|
86 |
|
87 |
-
title = "
|
88 |
-
description = ''' ## [High-Quality Image Restoration Following Human Instructions]
|
89 |
|
90 |
-
[
|
91 |
|
92 |
-
*
|
93 |
|
94 |
-
### TL;DR: quickstart
|
95 |
-
***InstructIR takes as input an image and a human-written instruction for how to improve that image.***
|
96 |
-
The (single) neural model performs all-in-one image restoration. InstructIR achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement.
|
97 |
-
**🚀 You can start with the [demo tutorial.](https://github.com/mv-lab/InstructIR/blob/main/demo.ipynb)** Check **[our github](https://github.com/mv-lab/InstructIR)** for more information
|
98 |
|
99 |
<details>
|
100 |
<summary> <b> Abstract</b> (click me to read)</summary>
|
101 |
<p>
|
102 |
-
|
|
|
|
|
|
|
|
|
103 |
</p>
|
104 |
</details>
|
105 |
|
106 |
-
> **Disclaimer:** please remember this is not a product, thus, you will notice some limitations. Due to the GPU memory limitations, the app might crash if you feed a high-resolution image (2K, 4K). <br>
|
107 |
-
**The model was trained using mostly synthetic data, thus it might not work great on real-world complex images.**
|
108 |
-
You can also try general image enhancement prompts (e.g., "retouch this image", "enhance the colors") and see how it improves the colors. As you can see, the model is quite efficient.
|
109 |
-
|
110 |
-
**Datasets:** We use these datasets BSD100, BSD68, Urban100, WED, Rain100, Aobe MIT5K, LOL, GoPro, SOTS (haze). This demo expects an image with some degradations (blur, noise, rain, low-light, haze).
|
111 |
-
<br>
|
112 |
-
|
113 |
-
<code>
|
114 |
-
@article{conde2024high,
|
115 |
-
title={High-Quality Image Restoration Following Human Instructions},
|
116 |
-
author={Conde, Marcos V and Geigle, Gregor and Timofte, Radu},
|
117 |
-
journal={arXiv preprint arXiv:2401.16468},
|
118 |
-
year={2024}
|
119 |
-
}
|
120 |
-
</code>
|
121 |
-
<br>
|
122 |
'''
|
123 |
|
124 |
-
|
125 |
-
article = "<p style='text-align: center'><a href='https://github.com/mv-lab/InstructIR' target='_blank'>High-Quality Image Restoration Following Human Instructions</a></p>"
|
126 |
-
|
127 |
#### Image,Prompts examples
|
128 |
examples = [['images/a4960.jpg', "my colors are too off, make it pop so I can use it in instagram"],
|
129 |
['images/rain-020.png', "I love this photo, could you remove the raindrops? please keep the content intact"],
|
|
|
84 |
|
85 |
|
86 |
|
87 |
+
title = "Digital Image Processing Project"
|
88 |
+
description = ''' ## [High-Quality Image Restoration Following Human Instructions]
|
89 |
|
90 |
+
[Arindham Srinivasan], [Arvind Venkat Ramanan]
|
91 |
|
92 |
+
*Vellore Institute of Technology
|
93 |
|
|
|
|
|
|
|
|
|
94 |
|
95 |
<details>
|
96 |
<summary> <b> Abstract</b> (click me to read)</summary>
|
97 |
<p>
|
98 |
+
The project explores novel avenues in high-quality image generation, integrating human-written instructions to guide image restoration processes. In an era where image restoration remains a crucial task for enhancing visual quality, traditional methods often rely on predefined algorithms tailored to specific degradation types. However, the project pioneers a paradigm shift by harnessing human instructions to inform the restoration model's decision-making process.
|
99 |
+
By utilizing natural language prompts, the project's model adeptly restores high-quality images from their degraded counterparts, accommodating a myriad of degradation types such as noise, blur, rain, haze, and low-light conditions. This approach signifies a departure from conventional restoration methodologies, offering a more intuitive and user-friendly approach to image enhancement.
|
100 |
+
Results from the project demonstrate significant advancements in image restoration, with state-of-the-art performance across various restoration tasks. The project's model outperforms previous all-in-one restoration methods by an average improvement of +1dB, showcasing its efficacy in producing superior image quality.
|
101 |
+
Furthermore, the project introduces a comprehensive dataset tailored to text-guided image restoration and enhancement, providing a benchmark for future research endeavors in this domain. By fostering a deeper integration of human input into the image restoration process, the project lays the groundwork for a more collaborative and user-centric approach to visual content enhancement.
|
102 |
+
In summary, the project's innovative utilization of human-written instructions represents a significant step forward in high-quality image generation. By harnessing the power of natural language prompts, the project empowers users to actively participate in the image restoration process, ultimately leading to superior visual outcomes.
|
103 |
</p>
|
104 |
</details>
|
105 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
106 |
'''
|
107 |
|
|
|
|
|
|
|
108 |
#### Image,Prompts examples
|
109 |
examples = [['images/a4960.jpg', "my colors are too off, make it pop so I can use it in instagram"],
|
110 |
['images/rain-020.png', "I love this photo, could you remove the raindrops? please keep the content intact"],
|