As an example of the recently introduced concept of rate of innovation, signals that are linear combinations of a finite number of Diracs per unit time can be acquired by linear filtering followed by uniform sampling. However, in reality, samples are rarely noiseless. In this paper, we introduce a novel stochastic algorithm to reconstruct a signal with finite rate of innovation from its noisy samples. Even though variants of this problem have been approached previously, satisfactory solutions are only available for certain classes of sampling kernels, for example, kernels that satisfy the Strang-Fix condition. In this paper, we consider the infinite-support Gaussian kernel, which does not satisfy the Strang-Fix condition. Other classes of kernels can be employed. Our algorithm is based on Gibbs sampling, a Markov chain Monte Carlo method. Extensive numerical simulations demonstrate the accuracy and robustness of our algorithm.
Signals with FRI were initially introduced by Vetterli @cite_24 . The reconstruction schemes hinged on identifying algebraically-independent parameters of the signals, e.g. the weights @math and time locations @math . In the seminal paper on FRI, the sampling kernel for finite signals was chosen to be either the sinc or the Gaussian. An annihilating filter approach led to an elegant algebraic solution via polynomial root finding and least squares. The authors alluded to the noisy case and suggested the use of the Singular Value Decomposition (SVD) for dealing with noisy samples. We will show that, in fact, this method is ill-conditioned because root-finding is itself not at all robust to noise. Thus it is not amenable to practical implementations, for instance on an ADC @.
@cite_24
2105483458 2125782250 1971056102 2158537680
In this paper, we consider the problem of sampling signals that are nonband-limited but have finite number of degrees of freedom per unit of time and call this number the rate of innovation. Streams of Diracs and piecewise polynomials are the examples of such signals, and thus are known as signals with finite rate of innovation (FRI). We know that the classical ("band-limited sine") sampling theory does not enable perfect reconstruction of such signals from their samples since they are not band-limited. However, the recent results on FRI sampling suggest that it is possible to sample and perfectly reconstruct such nonband-limited signals using a rich class of kernels. In this paper, we extend those results in higher dimensions using compactly supported kernels that reproduce polynomials (satisfy Strang-Fix conditions). In fact, the polynomial reproduction property of the kernel makes it possible to obtain the continuous moments of the signal from its samples. Using these moments and the annihilating filter method (Prony's method), the innovative part of the signal, and therefore, the signal itself is perfectly reconstructed. In particular, we present local (directional-derivatives-based) and global (complex-moments-based, Radon-transform-based) sampling schemes for classes of FRI signals such as sets of Diracs, bilevel, and planar polygons, quadrature domains (e.g., circles, ellipses, and cardioids), 2D polynomials with polygonal boundaries, and n-dimensional Diracs and convex polytopes. This work has been explored in a promising way in super-resolution algorithms and distributed compression, and might find its applications in photogrammetry, computer graphics, and machine vision. The finite rate of innovation (FRI) principle is developed for sampling a class of non-bandlimited signals that have a finite number of degrees of freedom per unit of time, i.e., signals with FRI. This sampling scheme is later extended to three classes of sampling kernels with compact support and applied to the step edge reconstruction problem by treating the image row by row. In this paper, we regard step edges as 2D FRI signals and reconstruct them block by block. The step edge parameters are obtained from the 2D moments of a given image block. Experimentally, our technique can reconstruct the edge more precisely and track the Cramer-Rao bounds (CRBs) closely with a signal-to-noise ratio (SNR) larger than 4 dB on synthetic step edge images. Experiments on real images show that our proposed method can reconstruct the step edges under practical conditions, i.e., in the presence of various types of noise and using a real sampling kernel. The results on locating the corners of data matrix barcodes using our method also outperform some state-of-the-art barcode decoders. In this paper, we extend the theory of sampling signals with finite rate of innovation (FRI) to a specific class of two-dimensional curves, which are defined implicitly as the zeros of a mask function. Here the mask function has a parametric representation as a weighted summation of a finite number of complex exponentials, and therefore, has finite rate of innovation . An associated edge image, which is discontinuous on the predefined parametric curve, is proved to satisfy a set of linear annihilation equations. We show that it is possible to reconstruct the parameters of the curve (i.e., to detect the exact edge positions in the continuous domain) based on the annihilation equations. Robust reconstruction algorithms are also developed to cope with scenarios with model mismatch. Moreover, the annihilation equations that characterize the curve are linear constraints that can be easily exploited in optimization problems for further image processing (e.g., image up-sampling). We demonstrate one potential application of the annihilation algorithm with examples in edge-preserving interpolation. Experimental results with both synthetic curves as well as edges of natural images clearly show the effectiveness of the annihilation constraint in preserving sharp edges, and improving SNRs. The authors consider classes of signals that have a finite number of degrees of freedom per unit of time and call this number the rate of innovation. Examples of signals with a finite rate of innovation include streams of Diracs (e.g., the Poisson process), nonuniform splines, and piecewise polynomials. Even though these signals are not bandlimited, we show that they can be sampled uniformly at (or above) the rate of innovation using an appropriate kernel and then be perfectly reconstructed. Thus, we prove sampling theorems for classes of signals and kernels that generalize the classic "bandlimited and sinc kernel" case. In particular, we show how to sample and reconstruct periodic and finite-length streams of Diracs, nonuniform splines, and piecewise polynomials using sinc and Gaussian kernels. For infinite-length signals with finite local rate of innovation, we show local sampling and reconstruction based on spline kernels. The key in all constructions is to identify the innovative part of a signal (e.g., time instants and weights of Diracs) using an annihilating or locator filter: a device well known in spectral analysis and error-correction coding. This leads to standard computational procedures for solving the sampling problem, which we show through experimental results. Applications of these new sampling results can be found in signal processing, communications systems, and biological systems.