It is known that in various random matrix models, large perturbations create outlier eigenvalues which lie, asymptotically, in the complement of the support of the limiting spectral density. This thesis studies fluctuations of these outlier eigenvalues of iid matrices @math under bounded rank and bounded operator norm perturbations @math , namely the fluctuations @math . The perturbations @math that we consider belong to a large class, where we allow for arbitrary Jordan types and almost minimal assumptions on the left and right eigenvectors. We obtain the joint convergence of the normalized asymptotic fluctuations of the outlier eigenvalues in this setting with a unified approach.
In @cite_4 , Bordenave and Captaine study asymptotic outlier locations and fluctuations for perturbed iid matrices. The perturbations considered there are of the form @math where @math is of bounded rank and @math (with possibly unbounded rank) satisfies a well-conditioning property. In the case of local perturbations, where @math has a finite nonzero block @math at the top-left, [Theorems 1.7 and 1.8] bc obtain the limiting normalized outlier fluctuation when @math and when @math under the hypothesis of bounded fourth moments.
@cite_4
2127184781 2951358417 2123372478 2952852844
We consider the non-parametric estimation of a function that is observed in white noise after convolution with a boxcar, the indicator of an interval ( a; a). In a recent paper Johnstone, Kerkyacharian, Picard and Raimondo (2004) have developed a wavelet deconvolution method (called WaveD) that can be used for " boxcar kernels. For example, WaveD can be tuned to achieve near optimal rates over Besov spaces when a is a Badly Approximable (BA) irrational number. While the set of all BA's contains quadratic irrationals, e.g., a = p 5, it has Lebesgue measure zero. In this paper we derive two tuning scenarios of WaveD that are valid for all" boxcar convolutions (i.e., when a 2 A where A is a full Lebesgue measure set). We propose (i) a tuning inspired from Minimax theory over Besov spaces; (ii) a tuning derived from Maxiset theory providing similar rates as for WaveD in the BA widths setting. Asymptotic theory nds that (i) in the worst case scenario, departures from the BA assumption aect WaveD convergence rates, at most, by log factors; (ii) the Maxiset tuning, which yields smaller thresholds, is superior to the Minimax tuning over a whole range of Besov sub-scales. Our asymptotic results are illustrated in an extensive simulation of boxcar convolution observed in white noise. This text is about spiked models of non Hermitian random matrices. More specifically, we consider matrices of the type @math , where the rank of @math stays bounded as the dimension goes to infinity and where the matrix @math is a non Hermitian random matrix, satisfying an isotropy hypothesis: its distribution is invariant under the left and right actions of the unitary group. The macroscopic eigenvalue distribution of such matrices is governed by the so called Single Ring Theorem, due to Guionnet, Krishnapur and Zeitouni. We first prove that if @math has some eigenvalues out of the maximal circle of the single ring, then @math has some eigenvalues (called outliers) in the neighborhood of those of @math , which is not the case for the eigenvalues of @math in the inner cycle of the single ring. Then, we study the fluctuations of the outliers of @math around the eigenvalues of @math and prove that they are distributed as the eigenvalues of some finite dimensional random matrices. Such facts had already been noticed for Hermitian models. More surprising facts are that outliers can here have very various rates of convergence to their limits (depending on the Jordan Canonical Form of @math ) and that some correlations can appear between outliers at a macroscopic distance from each other (a fact already noticed by Knowles and Yin in the Hermitian case, but only in the case of non Gaussian models, whereas spiked Gaussian matrices belong to our model and can have such correlated outliers). Our first result generalizes a previous result by Tao for matrices with i.i.d. entries, whereas the second one (about the fluctuations) is new. Hoeffding's U-statistics model combinatorial-type matrix parameters (appearing in CS theory) in a natural way. This paper proposes using these statistics for analyzing random compressed sensing matrices, in the non-asymptotic regime (relevant to practice). The aim is to address certain pessimisms of worst-case restricted isometry analyses, as observed by both Blanchard and Dossal, We show how U-statistics can obtain average-case analyses, by relating to statistical restricted isometry property (StRIP) type recovery guarantees. However unlike standard StRIP, random signal models are not required; the analysis used here holds in the almost sure (probabilistic) sense. For Gaussian bounded entry matrices, we show that both @math -minimization and LASSO essentially require on the order of @math measurements to respectively recover at least @math fraction, and @math fraction, of the signals. Noisy conditions are considered. Empirical evidence suggests our analysis to compare well to Donoho and Tanner's recent large deviation bounds for @math -equivalence, in the regime of block lengths @math with high undersampling ( @math measurements); similar system sizes are found in recent CS implementation. In this work, it is assumed throughout that matrix columns are independently sampled. The probability that a user will click a search result depends both on its relevance and its position on the results page. The position based model explains this behavior by ascribing to every item an attraction probability, and to every position an examination probability. To be clicked, a result must be both attractive and examined. The probabilities of an item-position pair being clicked thus form the entries of a rank- @math matrix. We propose the learning problem of a Bernoulli rank- @math bandit where at each step, the learning agent chooses a pair of row and column arms, and receives the product of their Bernoulli-distributed values as a reward. This is a special case of the stochastic rank- @math bandit problem considered in recent work that proposed an elimination based algorithm Rank1Elim, and showed that Rank1Elim's regret scales linearly with the number of rows and columns on "benign" instances. These are the instances where the minimum of the average row and column rewards @math is bounded away from zero. The issue with Rank1Elim is that it fails to be competitive with straightforward bandit strategies as @math . In this paper we propose Rank1ElimKL which simply replaces the (crude) confidence intervals of Rank1Elim with confidence intervals based on Kullback-Leibler (KL) divergences, and with the help of a novel result concerning the scaling of KL divergences we prove that with this change, our algorithm will be competitive no matter the value of @math . Experiments with synthetic data confirm that on benign instances the performance of Rank1ElimKL is significantly better than that of even Rank1Elim, while experiments with models derived from real data confirm that the improvements are significant across the board, regardless of whether the data is benign or not.