When there are more variables than observations do shrinkage methods (such as Ridge and Lasso) always find a solution?
The proof of shrinking coefficients using ridge regression through "spectral decomposition"