Low-Rank Matrix Recovery (LRMR) has recently been applied to saliency detection by decomposing image features into a low-rank component associated with background and a sparse component associated with visual salient regions. Despite its great potential, existing LRMR-based saliency detection methods seldom consider the inter-relationship among elements within these two components, thus are prone to generating scattered or incomplete saliency maps. In this paper, we introduce a novel and efficient LRMR-based saliency detection model under a coarse-to-fine framework to circumvent this limitation. First, we roughly measure the saliency of image regions with a baseline LRMR model that integrates a @math -norm sparsity constraint and a Laplacian regularization smooth term. Given samples from the coarse saliency map, we then learn a projection that maps image features to refined saliency values, to significantly sharpen the object boundaries and to preserve the object entirety. We evaluate our framework against existing LRMR based methods on three benchmark datasets. Experimental results validate the superiority of our method as well as the effectiveness of our suggested coarse-to-fine framework, especially for images containing multiple objects.
As a pioneering work, Itti @cite_22 innovatively suggested using Center and Surround" filters to extract image features and to simulate human vision system on multi-scale levels to generate saliency maps. Motivated by Itti's framework, various contrast based approaches have been developed in past decades, which include local-contrast-based ones (e.g., @cite_31 @cite_27 ), global-contrasts-based ones (e.g., @cite_23 @cite_34 @cite_3 ), or even those combining both local and global contrasts (e.g., @cite_13 @cite_0 @cite_18 ). Local contrast is estimated by measuring the difference between a center" pixel or small region with its neighbors, thus it is sensitive to high frequency changes such as edges and noises. On the contrary, global contrast is much more robust to local textures and edges, but they can fail to distinguish salient objects from the background that shares high similarity with the objects @cite_15 @cite_38 @cite_10 .
@cite_38 @cite_18 @cite_22 @cite_15 @cite_10 @cite_3 @cite_0 @cite_27 @cite_23 @cite_31 @cite_34 @cite_13
1978904636 2164720308 2417131217 2774447305
Researchers have been taking advantage of visual attention in various image processing applications such as image retargeting, video coding, etc. Recently, many saliency detection algorithms have been proposed by extracting features in spatial or transform domains. In this paper, a novel saliency detection model is introduced by utilizing low-level features obtained from the wavelet transform domain. Firstly, wavelet transform is employed to create the multi-scale feature maps which can represent different features from edge to texture. Then, we propose a computational model for the saliency map from these features. The proposed model aims to modulate local contrast at a location with its global saliency computed based on the likelihood of the features, and the proposed model considers local center-surround differences and global contrast in the final saliency map. Experimental evaluation depicts the promising results from the proposed model by outperforming the relevant state of the art saliency detection models. A spatiotemporal saliency algorithm based on a center-surround framework is proposed. The algorithm is inspired by biological mechanisms of motion-based perceptual grouping and extends a discriminant formulation of center-surround saliency previously proposed for static imagery. Under this formulation, the saliency of a location is equated to the power of a predefined set of features to discriminate between the visual stimuli in a center and a surround window, centered at that location. The features are spatiotemporal video patches and are modeled as dynamic textures, to achieve a principled joint characterization of the spatial and temporal components of saliency. The combination of discriminant center-surround saliency with the modeling power of dynamic textures yields a robust, versatile, and fully unsupervised spatiotemporal saliency algorithm, applicable to scenes with highly dynamic backgrounds and moving cameras. The related problem of background subtraction is treated as the complement of saliency detection, by classifying nonsalient (with respect to appearance and motion dynamics) points in the visual field as background. The algorithm is tested for background subtraction on challenging sequences, and shown to substantially outperform various state-of-the-art techniques. Quantitatively, its average error rate is almost half that of the closest competitor. In this paper, we propose a new method for detecting primary objects in unconstrained videos in a completely automatic setting. Here, we define the primary object in a video as the object that presents saliently in most of the frames. Unlike previous works considering only local saliency detection or common pattern discovery, the proposed method integrates the local visual motion saliency extracted from each frame, global appearance consistency throughout the video, and spatiotemporal smoothness constraint on object trajectories. We first identify a temporal coherent salient region throughout the whole video, and then explicitly learn a global appearance model to distinguish the primary object against the background. In order to obtain high-quality saliency estimations from both appearance and motion cues, we propose a novel self-adaptive saliency map fusion method by learning the reliability of saliency maps from labeled data. As a whole, our method can robustly localize and track primary objects in diverse video content, and handle the challenges such as fast object and camera motion, large scale and appearance variation, background clutter, and pose deformation. Moreover, compared with some existing approaches that assume the object is present in all the frames, our approach can naturally handle the case where the object is present only in part of the frames, e.g., the object enters the scene in the middle of the video or leaves the scene before the video ends. We also propose a new video data set containing 51 videos for primary object detection with per-frame ground-truth labeling. Quantitative experiments on several challenging video data sets demonstrate the superiority of our method compared with the recent state of the arts. Contrast is a very important characteristic for visual perception of image quality. Some No-Reference Image Quality Assessment Algorithm NR-IQA metrics for Contrast-Distorted Images (CDI) have been proposed in the literature, e.g. Reduced-reference Image Quality Metric for Contrast-changed images (RIQMC) and NR-IQA for Contrast-Distorted Images (NR-IQACDI). Here, we intend to improve the assessment results of images available in databases such as TID2013 and CSIQ. Most of the NR-IQA metrics (e.g. NR-IQACDI) designed for CDI adopt features available in the spatial domain. This paper proposes to compliment it with feature in Curvelet domain which is powerful in capturing multiscale and multidirectional information in an image. We employed the Natural Scene Statistics (NSS) features in Curvelet domain originally recommended by (2014) which were found useful in the assessment of the quality of image distorted by compression, noise and blurring. Experiments were then conducted to assess the effect of incorporating these NSS features. The experimental results based on K-fold cross validation (K ranged from 2 to 10) and statistical test showed that the performance of NRIQACDI was improved. Future works include improvements of NRIQACDI, exploration of feature fusion methods and using a suitable feature selection method.