7778586
Simulink Modeling and Comparison of Zhang Neural Networks and Gradient Neural Networks for Time-Varying Lyapunov Equation Solving
In view of the great potential in parallel processing and ready implementation via hardware, neural networks are now often employed to solve online matrix algebraic problems. Recently, a special kind of recurrent neural network has been proposed by Zhang et al, which could be generalized to solving online Lyapunov equation with time-varying coefficient matrices. In comparison with gradient-based neural networks (GNN), the resultant Zhang neural networks (ZNN) perform much better on solving these time-varying problems. This paper investigates the MATLAB Simulink modeling, simulative verification and comparison of ZNN and GNN models for time-varying Lyapunov equation solving. Computer-simulation results verify that superior convergence and efficacy could be achieved by such ZNN models when solving the time-varying Lyapunov matrix equation, as compared to the GNN models.
35419934
MATLAB Simulation of Gradient-Based Neural Network for Online Matrix Inversion
This paper investigates the simulation of a gradient-based recurrent neural network for online solution of the matrix-inverse problem. Several important techniques are employed as follows to simulate such a neural system. 1) Kronecker product of matrices is introduced to transform a matrix-differential-equation (MDE) to a vector-differential-equation (VDE); i.e., finally, a standard ordinary-differential-equation (ODE) is obtained. 2) MATLAB routine "ode45" is introduced to solve the transformed initial-value ODE problem. 3) In addition to various implementation errors, different kinds of activation functions are simulated to show the characteristics of such a neural network. Simulation results substantiate the theoretical analysis and efficacy of the gradient-based neural network for online constant matrix inversion.
15986478
MATLAB Simulink Modeling and Simulation of Zhang Neural Network for Online Time-Varying Matrix Inversion
Recently, a special kind of recurrent neural networks (RNN) with implicit dynamics has been proposed by Zhang et al for online time-varying problems solving (such as time-varying matrix inversion). Such a neural-dynamic system is elegantly designed by defining a matrix-valued error function rather than the usual scalar-valued norm-based error function. Its computational error can be made decrease to zero globally and exponentially. For the final purpose of field programmable gate array (FPGA) and application-specific integrated circuit (ASIC) realization, we investigate in this paper the MATLAB Simulink modeling and simulative verification of such a Zhang neural network (ZNN). By using click-and-drag mouse operations, it is easier to model and simulate in comparison with MATLAB coding. Both convergence and robustness properties of such a ZNN model are analyzed, which substantiate the effectiveness of Zhang neural network on inverting the time-varying matrices.
1213875
A simplified LVI-based primal-dual neural network for repetitive motion planning of PA10 robot manipulator starting from different initial states
This paper presents a simplified primal-dual neural network based on linear variational inequalities (LVI) for online repetitive motion planning of PA10 robot manipulator. To do this, a drift-free criterion is exploited in the form of a quadratic function. In addition, the repetitive-motion-planning scheme could incorporate the joint limits and joint velocity limits simultaneously. Such a scheme is finally reformulated as a time-varying quadratic program (QP). As a QP real-time solver, the simplified LVI-based primal-dual neural network (LVI-PDNN) is designed based on the QP-LVI conversion and Karush-Kuhn-Tucker (KKT) conditions. It has a simple piecewise-linear dynamics and could globally exponentially converge to the optimal solution of strictly-convex quadratic-programs. The simplified LVI-PDNN model is simulated based on PA10 robot arm, and simulation results show the effective remedy of the joint angle drift problem of PA10 robot.
11395736
Repetitive motion of redundant robots planned by three kinds of recurrent neural networks and illustrated with a four-link planar manipulator's straight-line example
In this paper, a dual neural network, LVI (linear variational inequalities)-based primal-dual neural network and simplified LVI-based primal-dual neural network are presented for online repetitive motion planning (RMP) of redundant robot manipulators (with a four-link planar manipulator as an example). To do this, a drift-free criterion is exploited in the form of a quadratic performance index. In addition, the repetitive-motion-planning scheme could incorporate the joint physical limits such as joint limits and joint velocity limits simultaneously. Such a scheme is finally reformulated as a quadratic program (QP). As QP real-time solvers, the aforementioned three kinds of neural networks all have piecewise-linear dynamics and could globally exponentially converge to the optimal solution of strictly-convex quadratic-programs. Furthermore, the neural-network based RMP scheme is simulated based on a four-link planar robot manipulator. Computer-simulation results substantiate the theoretical analysis and also show the effective remedy of the joint angle drift problem of robot manipulators.
3106142
MATLAB Simulation and Comparison of Zhang Neural Network and Gradient Neural Network for Online Solution of Linear Time-Varying Matrix Equation AXB-C=0
Different from gradient neural networks (GNN), a special kind ofrecurrent neural networks has been proposed recently by Zhanget alfor solving online linear matrix equations withtime-varying coefficients. Such recurrent neural networks, designedbased on a matrix-valued error-function, could achieve globalexponential convergence when solving online time-varying problemsin comparison with gradient neural networks. This paperinvestigates the MATLAB simulation of Zhang neural networks (ZNN)for real-time solution of linear time-varying matrix equationAXB- C= 0. Gradient neural networks aresimulated and compared as well. Simulation results substantiate thetheoretical analysis and efficacy of ZNN on linear time-varyingmatrix equation solving.
41045084
Parallel algorithms of the Purcell method for direct solution of linear systems
In this paper, we first demonstrate that the classical Purcell's vector method when combined with row pivoting yields a consistently small growth factor in comparison to the well-known Gauss elimination method, the Gauss-Jordan method and the Gauss-Huard method with partial pivoting. We then present six parallel algorithms of the Purcell method that may be used for direct solution of linear systems. The algorithms differ in ways of pivoting and load balancing. We recommend algorithms V and VI for their reliability and algorithms III and IV for good load balance if local pivoting is acceptable. Some numerical results are presented.
19202214
A self-generating modular neural network architecture for supervised learning
Abstract In this paper, we present a self-generating modular neural network architecture for supervised learning. In the architecture, any kind of feedforward neural networks can be employed as component nets. For a given task, a tree-structured modular neural network is automatically generated with a growing algorithm by partitioning input space recursively to avoid the problem of pre-determined structure. Due to the principle of divide-and-conquer used in the proposed architecture, the modular neural network can yield both good performance and significantly faster training. The proposed architecture has been applied to several supervised learning tasks and has achieved satisfactory results.
28337697
Trends in Neural Computation
Hyperbolic Function Networks for Pattern Classification.- Variable Selection for the Linear Support Vector Machine.- Selecting Data for Fast Support Vector Machines Training.- Universal Approach to Study Delayed Dynamical Systems.- A Hippocampus-Neocortex Model for Chaotic Association.- Latent Attractors: A General Paradigm for Context-Dependent Neural Computation.- Learning Mechanisms in Networks of Spiking Neurons.- GTSOM: Game Theoretic Self-organizing Maps.- How to Generate Different Neural Networks.- A Gradient-Based Forward Greedy Algorithm for Space Gaussian Process Regression.- An Evolved Recurrent Neural Network and Its Application.- A Min-Max Modular Network with Gaussian-Zero-Crossing Function.- Combining Competitive Learning Networks of Various Representations for Sequential Data Clustering.- Modular Neural Networks and Their Applications in Biometrics.- Performance Analysis of Dynamic Cell Structures.- Short Term Electric Load Forecasting: A Tutorial.- Performance Improvement for Formation-Keeping Control Using a Neural Network HJI Approach.- A Robust Blind Neural Equalizer Based on Higher-Order Cumulants.- The Artificial Neural Network Applied to Servo Control System.- Robot Localization Using Vision.
15785287
A Nonlinear Multigrid Method for Total Variation Minimization from Image Restoration
Abstract
Image restoration has been an active research topic and variational formulations are particularly effective in high quality recovery. Although there exist many modelling and theoretical results, available iterative solvers are not yet robust in solving such modeling equations. Recent attempts on developing optimisation multigrid methods have been based on first order conditions. Different from this idea, this paper proposes to use piecewise linear function spanned subspace correction to design a multilevel method for directly solving the total variation minimisation. Our method appears to be more robust than the primal-dual method (Chan et al., SIAM J. Sci. Comput. 20(6), 1964–1977, 1999) previously found reliable. Supporting numerical results are presented.

10375004
Optimal Search Model for Combined Strategy in Sequence Alignment
A low power sense amplifier having bit line sensors for sensing the respective voltage levels of a plurality of bit lines, and a latch connected by data lines to the bit lines sensor, for latching the sensed voltage levels. Circuitry of the amplifier prevents formation of a conductive path to ground through both the bit line sensors and the latch when the sensed voltage levels are latched. This provides a sense amplifier which is low in power consumption, while maintaining a relatively high speed, which is particularly useful in CMOS memories.