16708333
MATLAB Simulation and Comparison of Zhang Neural Network and Gradient Neural Network for Time-Varying Lyapunov Equation Solving
This paper presents a new kind of recurrent neural network proposed by Zhang et al.for solving online Lyapunov equation with time-varying coefficient matrices. Global exponential convergence could be achieved by such a recurrent neural network when solving the time-varying problems in comparison with gradient neural networks (GNN). MATLAB simulation of both neural networks for the real-time solution of time-varying Lyapunov equation is then investigated through several important techniques. Computer-simulation results substantiate the theoretical analysis and demonstrate the efficacy of such a Zhang neural network (ZNN) on time-varying Lyapunov equation solving, especially when using power-sigmoid activation functions.
11395736
Repetitive motion of redundant robots planned by three kinds of recurrent neural networks and illustrated with a four-link planar manipulator's straight-line example
In this paper, a dual neural network, LVI (linear variational inequalities)-based primal-dual neural network and simplified LVI-based primal-dual neural network are presented for online repetitive motion planning (RMP) of redundant robot manipulators (with a four-link planar manipulator as an example). To do this, a drift-free criterion is exploited in the form of a quadratic performance index. In addition, the repetitive-motion-planning scheme could incorporate the joint physical limits such as joint limits and joint velocity limits simultaneously. Such a scheme is finally reformulated as a quadratic program (QP). As QP real-time solvers, the aforementioned three kinds of neural networks all have piecewise-linear dynamics and could globally exponentially converge to the optimal solution of strictly-convex quadratic-programs. Furthermore, the neural-network based RMP scheme is simulated based on a four-link planar robot manipulator. Computer-simulation results substantiate the theoretical analysis and also show the effective remedy of the joint angle drift problem of robot manipulators.
1213875
A simplified LVI-based primal-dual neural network for repetitive motion planning of PA10 robot manipulator starting from different initial states
This paper presents a simplified primal-dual neural network based on linear variational inequalities (LVI) for online repetitive motion planning of PA10 robot manipulator. To do this, a drift-free criterion is exploited in the form of a quadratic function. In addition, the repetitive-motion-planning scheme could incorporate the joint limits and joint velocity limits simultaneously. Such a scheme is finally reformulated as a time-varying quadratic program (QP). As a QP real-time solver, the simplified LVI-based primal-dual neural network (LVI-PDNN) is designed based on the QP-LVI conversion and Karush-Kuhn-Tucker (KKT) conditions. It has a simple piecewise-linear dynamics and could globally exponentially converge to the optimal solution of strictly-convex quadratic-programs. The simplified LVI-PDNN model is simulated based on PA10 robot arm, and simulation results show the effective remedy of the joint angle drift problem of PA10 robot.
35419934
MATLAB Simulation of Gradient-Based Neural Network for Online Matrix Inversion
This paper investigates the simulation of a gradient-based recurrent neural network for online solution of the matrix-inverse problem. Several important techniques are employed as follows to simulate such a neural system. 1) Kronecker product of matrices is introduced to transform a matrix-differential-equation (MDE) to a vector-differential-equation (VDE); i.e., finally, a standard ordinary-differential-equation (ODE) is obtained. 2) MATLAB routine "ode45" is introduced to solve the transformed initial-value ODE problem. 3) In addition to various implementation errors, different kinds of activation functions are simulated to show the characteristics of such a neural network. Simulation results substantiate the theoretical analysis and efficacy of the gradient-based neural network for online constant matrix inversion.
3106142
MATLAB Simulation and Comparison of Zhang Neural Network and Gradient Neural Network for Online Solution of Linear Time-Varying Matrix Equation AXB-C=0
Different from gradient neural networks (GNN), a special kind ofrecurrent neural networks has been proposed recently by Zhanget alfor solving online linear matrix equations withtime-varying coefficients. Such recurrent neural networks, designedbased on a matrix-valued error-function, could achieve globalexponential convergence when solving online time-varying problemsin comparison with gradient neural networks. This paperinvestigates the MATLAB simulation of Zhang neural networks (ZNN)for real-time solution of linear time-varying matrix equationAXB- C= 0. Gradient neural networks aresimulated and compared as well. Simulation results substantiate thetheoretical analysis and efficacy of ZNN on linear time-varyingmatrix equation solving.
15986478
MATLAB Simulink Modeling and Simulation of Zhang Neural Network for Online Time-Varying Matrix Inversion
Recently, a special kind of recurrent neural networks (RNN) with implicit dynamics has been proposed by Zhang et al for online time-varying problems solving (such as time-varying matrix inversion). Such a neural-dynamic system is elegantly designed by defining a matrix-valued error function rather than the usual scalar-valued norm-based error function. Its computational error can be made decrease to zero globally and exponentially. For the final purpose of field programmable gate array (FPGA) and application-specific integrated circuit (ASIC) realization, we investigate in this paper the MATLAB Simulink modeling and simulative verification of such a Zhang neural network (ZNN). By using click-and-drag mouse operations, it is easier to model and simulate in comparison with MATLAB coding. Both convergence and robustness properties of such a ZNN model are analyzed, which substantiate the effectiveness of Zhang neural network on inverting the time-varying matrices.
3879090
On A Recursive Schur Preconditioner For Iterative Solution Of A Class Of Dense Matrix Problems
There are currently several distinct preconditioning methods for dense matrices based on applying a wavelet transform to obtain a matrix with a large number of small entries. A sparse preconditioner for this transformed matrix can be formed by setting to zero entries that are assumed to be unimportant. The effectiveness of the preconditioner depends on retaining the most important entries and on ensuring that they are positioned conveniently within the transformed matrix. In this paper we present a new, recursive preconditioning strategy that takes into account more of the significant entries without greatly increasing cost and outperforms existing methods in certain cases.
28337697
Trends in Neural Computation
Hyperbolic Function Networks for Pattern Classification.- Variable Selection for the Linear Support Vector Machine.- Selecting Data for Fast Support Vector Machines Training.- Universal Approach to Study Delayed Dynamical Systems.- A Hippocampus-Neocortex Model for Chaotic Association.- Latent Attractors: A General Paradigm for Context-Dependent Neural Computation.- Learning Mechanisms in Networks of Spiking Neurons.- GTSOM: Game Theoretic Self-organizing Maps.- How to Generate Different Neural Networks.- A Gradient-Based Forward Greedy Algorithm for Space Gaussian Process Regression.- An Evolved Recurrent Neural Network and Its Application.- A Min-Max Modular Network with Gaussian-Zero-Crossing Function.- Combining Competitive Learning Networks of Various Representations for Sequential Data Clustering.- Modular Neural Networks and Their Applications in Biometrics.- Performance Analysis of Dynamic Cell Structures.- Short Term Electric Load Forecasting: A Tutorial.- Performance Improvement for Formation-Keeping Control Using a Neural Network HJI Approach.- A Robust Blind Neural Equalizer Based on Higher-Order Cumulants.- The Artificial Neural Network Applied to Servo Control System.- Robot Localization Using Vision.
21847139
An Analysis of Sparse Approximate Inverse Preconditioners for Boundary Integral Equations
Preconditioning techniques for dense linear systems arising from singular boundary integral equations are described and analyzed. A particular class of approximate inverse based preconditioners related to the mesh neighbor methods is known to be efficient. This paper shows that it is an operator splitting preconditioner and clusters eigenvalues for the normal equation matrix thus ensuring a fast convergence of the conjugate gradient normal method. Clustering of the eigenvalues of the preconditioned matrix and fast convergence of the generalized minimal residual method are also observed. For the type of problems considered, we demonstrate a crucial connection between two essential features of eigenvalue clustering for a sparse preconditioner---approximate inversion for a small cluster radius and operator splitting for a small cluster size. Experimental results from several boundary integral equations are presented.
19202214
A self-generating modular neural network architecture for supervised learning
Abstract In this paper, we present a self-generating modular neural network architecture for supervised learning. In the architecture, any kind of feedforward neural networks can be employed as component nets. For a given task, a tree-structured modular neural network is automatically generated with a growing algorithm by partitioning input space recursively to avoid the problem of pre-determined structure. Due to the principle of divide-and-conquer used in the proposed architecture, the modular neural network can yield both good performance and significantly faster training. The proposed architecture has been applied to several supervised learning tasks and has achieved satisfactory results.
64402095
Trends in Neural Computation (Studies in Computational Intelligence)