This paper addresses the problem of photometric stereo for non-Lambertian surfaces. Existing approaches often adopt simplified reflectance models to make the problem more tractable, but this greatly hinders their applications on real-world objects. In this paper, we propose a deep fully convolutional network, called PS-FCN, that takes an arbitrary number of images of a static object captured under different light directions with a fixed camera as input, and predicts a normal map of the object in a fast feed-forward pass. Unlike the recently proposed learning based method, PS-FCN does not require a pre-defined set of light directions during training and testing, and can handle multiple images and light directions in an order-agnostic manner. Although we train PS-FCN on synthetic data, it can generalize well on real datasets. We further show that PS-FCN can be easily extended to handle the problem of uncalibrated photometric stereo.Extensive experiments on public real datasets show that PS-FCN outperforms existing approaches in calibrated photometric stereo, and promising results are achieved in uncalibrated scenario, clearly demonstrating its effectiveness.
Outlier rejection based methods assume non-Lambertian observations to be local and sparse such that they can be treated as outliers. Various outlier rejection methods have been proposed based on rank minimization @cite_15 , RANSAC @cite_18 , taking median values @cite_4 , expectation maximization @cite_26 , sparse Bayesian regression @cite_11 , etc. Outlier rejection methods generally require lots of input images and have difficulty in handling objects with dense non-Lambertian observations (e.g., materials with broad and soft specular highlights).
@cite_18 @cite_26 @cite_4 @cite_15 @cite_11
1978356057 54422097 1664169458 2275123856
This paper presents a robust photometric stereo method that effectively compensates for various non-Lambertian corruptions such as specularities, shadows, and image noise. We construct a constrained sparse regression problem that enforces both Lambertian, rank-3 structure and sparse, additive corruptions. A solution method is derived using a hierarchical Bayesian approximation to accurately estimate the surface normals while simultaneously separating the non-Lambertian corruptions. Extensive evaluations are performed that show state-of-the-art performance using both synthetic and real-world images. We consider high dimensional sparse regression with arbitrary - possibly, severe or coordinated - errors in the covariates matrix. We are interested in understanding how many corruptions we can tolerate, while identifying the correct support. To the best of our knowledge, neither standard outlier rejection techniques, nor recently developed robust regression algorithms (that focus only on corrupted response variables), nor recent algorithms for dealing with stochastic noise or erasures, can provide guarantees on support recovery. As we show, neither can the natural brute force algorithm that takes exponential time to find the subset of data and support columns, that yields the smallest regression error. We explore the power of a simple idea: replace the essential linear algebraic calculation - the inner product - with a robust counterpart that cannot be greatly affected by a controlled number of arbitrarily corrupted points: the trimmed inner product. We consider three popular algorithms in the uncorrupted setting: Thresholding Regression, Lasso, and the Dantzig selector, and show that the counterparts obtained using the trimmed inner product are provably robust. We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix @math . These may come from corrupted data, persistent experimental errors, or malicious respondents in surveys recommender systems, etc. Such non-stochastic error-in-variables problems are notoriously difficult to treat, and as we demonstrate, the problem is particularly pronounced in high-dimensional settings where the primary goal is support recovery of the sparse regressor. We develop algorithms for support recovery in sparse regression, when some number @math out of @math total covariate response pairs are arbitrarily (possibly maliciously) corrupted . We are interested in understanding how many outliers, @math , we can tolerate, while identifying the correct support. To the best of our knowledge, neither standard outlier rejection techniques, nor recently developed robust regression algorithms (that focus only on corrupted response variables), nor recent algorithms for dealing with stochastic noise or erasures, can provide guarantees on support recovery. Perhaps surprisingly, we also show that the natural brute force algorithm that searches over all subsets of @math covariate response pairs, and all subsets of possible support coordinates in order to minimize regression error, is remarkably poor, unable to correctly identify the support with even @math corrupted points, where @math is the sparsity. This is true even in the basic setting we consider, where all authentic measurements and noise are independent and sub-Gaussian. In this setting, we provide a simple algorithm -- no more computationally taxing than OMP -- that gives stronger performance guarantees, recovering the support with up to @math corrupted points, where @math is the dimension of the signal to be recovered. Recent development of compressive sensing has greatly benefited radar imaging problems. In this paper, we investigate the problem of obtaining enhanced targets such as ships and airplanes, where targets often exhibit structured sparsity. A novel structured sparsity-driven autofocus algorithm is proposed based on sparse Bayesian framework.The structured sparse prior is imposed on the target scene in a statistical manner. Based on a statistical framework, the proposed algorithm can simultaneously cope with structured sparse recovery and phase error correction problem. The focused high-resolution radar image can be obtained by iteratively estimating scattering coefficients and phase. Due to the structured sparse constraint, the proposed algorithm can desirably preserve the target region and alleviate over-shrinkage problem, compared to previous sparsity-driven auto-focus approaches.Moreover, to accelerate convergence rate of the algorithm, we propose to adaptively eliminate noise-only range cells in estimating phase errors. The selection is conveniently conducted based on the parameters controlling sparsity degree of the signal in the proposed hierarchical model.The simulated and real data experimental results demonstrate that the proposed algorithm can obtain more concentrated images with much smaller number of iterations, particularly in low SNR and highly under-sampling scenarios. HighlightsA novel structured sparsity-driven autofocus algorithm is proposed based on sparse Bayesian framework.To accelerate convergence rate of the algorithm, we propose to adaptively eliminate noise-only range cells in phase error estimation stage.The proposed algorithm can obtain more concentrated images with much smaller number of iterations, particularly in low SNR and highly under-sampling scenarios.