Deep convolutional neural networks perform better on images containing spatially invariant noise (synthetic noise); however, their performance is limited on real-noisy photographs and requires multiple stage network modeling. To advance the practicability of denoising algorithms, this paper proposes a novel single-stage blind real image denoising network (RIDNet) by employing a modular architecture. We use a residual on the residual structure to ease the flow of low-frequency information and apply feature attention to exploit the channel dependencies. Furthermore, the evaluation in terms of quantitative metrics and visual quality on three synthetic and four real noisy datasets against 19 state-of-the-art algorithms demonstrate the superiority of our RIDNet.
In this section, we present and discuss recent trends in the image denoising. Two notable denoising algorithms, NLM @cite_56 and BM3D @cite_62 , use self-similar patches. Due to theer sucess, many variants were proposed, including SADCT @cite_36 , SAPCA @cite_52 , NLB @cite_7 , and INLM @cite_60 which seek self-similar patches in different transform domains. Dictionary-based methods @cite_31 @cite_8 @cite_22 enforce sparsity by employing self-similar patches and learning over-complete dictionaries from clean images. Many algorithms @cite_54 @cite_15 @cite_32 investigated the maximum likelihood algorithm to learn a statistical prior, the Gaussian Mixture Model of natural patches or patch groups for patch restoration. Furthermore, Levin al @cite_51 and Chatterjee al @cite_43 , motivated external denoising @cite_55 @cite_26 @cite_61 @cite_27 by showing that an image can be recovered with negligible error by selecting reference patches from a clean external database. However, all of the external algorithms are class-specific.
@cite_61 @cite_62 @cite_26 @cite_22 @cite_7 @cite_60 @cite_36 @cite_8 @cite_54 @cite_15 @cite_55 @cite_52 @cite_32 @cite_56 @cite_43 @cite_27 @cite_31 @cite_51
2207282238 2203654268 2122911643 2240914251
Patch based image modeling has achieved a great success in low level vision such as image denoising. In particular, the use of image nonlocal self-similarity (NSS) prior, which refers to the fact that a local patch often has many nonlocal similar patches to it across the image, has significantly enhanced the denoising performance. However, in most existing methods only the NSS of input degraded image is exploited, while how to utilize the NSS of clean natural images is still an open problem. In this paper, we propose a patch group (PG) based NSS prior learning scheme to learn explicit NSS models from natural images for high performance denoising. PGs are extracted from training images by putting nonlocal similar patches into groups, and a PG based Gaussian Mixture Model (PG-GMM) learning algorithm is developed to learn the NSS prior. We demonstrate that, owe to the learned PG-GMM, a simple weighted sparse coding model, which has a closed-form solution, can be used to perform image denoising effectively, resulting in high PSNR measure, fast speed, and particularly the best visual quality among all competing methods. Natural image modeling plays a key role in many vision problems such as image denoising. Image priors are widely used to regularize the denoising process, which is an illposed inverse problem. One category of denoising methods exploit the priors (e.g., TV, sparsity) learned from external clean images to reconstruct the given noisy image, while another category of methods exploit the internal prior (e.g., self-similarity) to reconstruct the latent image. Though the internal prior based methods have achieved impressive denoising results, the improvement of visual quality will become very difficult with the increase of noise level. In this paper, we propose to exploit image external patch prior and internal self-similarity prior jointly, and develop an external patch prior guided internal clustering algorithm for image denoising. It is known that natural image patches form multiple subspaces. By utilizing Gaussian mixture models (GMMs) learning, image similar patches can be clustered and the subspaces can be learned. The learned GMMs from clean images are then used to guide the clustering of noisypatches of the input noisy images, followed by a low-rank approximation process to estimate the latent subspace for image recovery. Numerical experiments show that the proposed method outperforms many state-of-the-art denoising algorithms such as BM3D and WNNM. We propose a data-dependent denoising procedure to restore noisy images. Different from existing denoising algorithms which search for patches from either the noisy image or a generic database, the new algorithm finds patches from a database that contains relevant patches. We formulate the denoising problem as an optimal filter design problem and make two contributions. First, we determine the basis function of the denoising filter by solving a group sparsity minimization problem. The optimization formulation generalizes existing denoising algorithms and offers systematic analysis of the performance. Improvement methods are proposed to enhance the patch search process. Second, we determine the spectral coefficients of the denoising filter by considering a localized Bayesian prior. The localized prior leverages the similarity of the targeted database, alleviates the intensive Bayesian computation, and links the new method to the classical linear minimum mean squared error estimation. We demonstrate applications of the proposed method in a variety of scenarios, including text images, multiview images, and face images. Experimental results show the superiority of the new algorithm over existing methods. The restoration of clean remote sensing images from the degraded images is usually an ill-posed problem. A feasible solution for the problem is incorporating various priors into restoration procedure as constrained conditions. Recently, the patch-based Gaussian mixture model (GMM) priors became popular. However, the learning of patch-based GMM priors usually assumes the components of the GMM are independent and identically distributed (i.i.d.). The assumption means that two components could model the same training samples, and thus a possible decrease in model’s description ability. This work presents a new learning method to diversify the patch-based GMM priors through modeling the GMM’s parameters as a determinantal point process (DPP). The introduction of DPP allows us to specify a preference for diversity in patch-based GMM using a positive definite kernel function and thus to increase the model’s description ability for a given model complexity. Furthermore, under the expected patch log-likelihood (EPLL) restoration framework, we further introduce the diversified patch-based GMM priors into remote sensing literature and develop new remote sensing image restoration algorithms. The extensive experiments for denoising and deblurring of remote sensing images demonstrated that the proposed algorithms produced better restoration results than other methods that already proven to perform well in the literature.