In order to improve the performance of least mean square (LMS)-based adaptive filtering for identifying block-sparse systems, a new adaptive algorithm called block-sparse LMS (BS-LMS) is proposed in this paper. The basis of the proposed algorithm is to insert a penalty of block-sparsity, which is a mixed @math norm of adaptive tap-weights with equal group partition sizes, into the cost function of traditional LMS algorithm. To describe a block-sparse system response, we first propose a Markov-Gaussian model, which can generate a kind of system responses of arbitrary average sparsity and arbitrary average block length using given parameters. Then we present theoretical expressions of the steady-state misadjustment and transient convergence behavior of BS-LMS with an appropriate group partition size for white Gaussian input data. Based on the above results, we theoretically demonstrate that BS-LMS has much better convergence behavior than @math -LMS with the same small level of misadjustment. Finally, numerical experiments verify that all of the theoretical analysis agrees well with simulation results in a large range of parameters.
Recursive least squares (RLS) is another important branch in adaptive filtering. Its faster convergence rate compared to LMS makes RLS an intriguing adaptive paradigm. In @cite_18 , group sparsity cognizant RLS is proposed by using various mixed norms, including @math norm, @math norm, @math norm, and @math norm. Numerical experiments show that the novel group sparse RLS is effective and robust for the block-sparse system identification problem, and provides improved performance when compared to the references that only exploit sparsity.
@cite_18
1551912413
SUMMARY Group sparsity is one of the important signal priors for regularization of inverse problems. Sparsity with group structure is encountered in numerous applications. However, despite the abundance of sparsity-based adaptive algorithms, attempts at group sparse adaptive methods are very scarce. In this paper, we introduce novel recursive least squares (RLS) adaptive algorithms regularized via penalty functions, which promote group sparsity. We present a new analytic approximation for lp,0 norm to utilize it as a group sparse regularizer. Simulation results confirm the improved performance of the new group sparse algorithms over regular and sparse RLS algorithms when group sparse structure is present. Copyright © 2013 John Wiley & Sons, Ltd.