@inproceedings{
tang2023solving,
title={Solving Noisy Inverse Problems via Posterior Sampling: A Policy Gradient View-Point},
author={Haoyue Tang and Tian Xie and Aosong Feng and Hanyu Wang and Chenyang Zhang and Yang Bai},
booktitle={The Symbiosis of Deep Learning and Differential Equations III},
year={2023},
url={https://openreview.net/forum?id=1phOqr675L}
}
Solving image inverse problems (e.g., super-resolution and inpainting) requires generating a high fidelity image that matches the given input (the low-resolution image or the masked image). By using the input image as guidance, we can leverage a pretrained diffusion generation model to solve a wide range of image inversion tasks without task specific model fine-tuning. In this work, we propose diffusion policy gradient (DPG), a tractable computation method to estimate the score function given the guidance image. Our method is robust to both Gaussian and Poisson noise added to the input image, and it improves the image restoration consistency and quality on FFHQ, ImageNet and LSUN datasets on both linear and non-linear image inversion tasks (inpainting, super-resolution, motion deblur, non-linear deblur, etc.).
Solving Noisy Inverse Problems via Posterior Sampling: A Policy Gradient View-Point
Haoyue Tang Tian Xie Aosong Feng Hanyu Wang Chenyang Zhang Yang Bai