52833236
Boosting Input/Output Hidden Markov Models for Sequence Classification
Input/output hidden Markov model (IOHMM) has turned out to be effective in sequential data processing via supervised learning. However, there are several difficulties, e.g. model selection, unexpected local optima and high computational complexity, which hinder an IOHMM from yielding the satisfactory performance in sequence classification. Unlike previous efforts, this paper presents an ensemble learning approach to tackle the aforementioned problems of the IOHMM. As a result, simple IOHMMs of different topological structures are used as base learners in our boosting algorithm and thus an ensemble of simple IOHMMs tend to tackle a complicated sequence classification problem without the need of explicit model selection. Simulation results in text-dependent speaker identification demonstrate the effectiveness of boosted IOHMMs for sequence classification.
41845464
Advances in Natural Computation, First International Conference, ICNC 2005, Changsha, China, August 27-29, 2005, Proceedings, Part I
15381679
A Modular Neural Network Architecture for Pattern Classification Based on Different Feature Sets
We propose a novel connectionist method for the use of different feature sets in pattern classification. Unlike traditional methods, e.g., combination of multiple classifiers and use of a composite feature set, our method copes with the problem based on an idea of soft competition on different feature sets developed in our earlier work. An alternative modular neural network architecture is proposed to provide a more effective implementation of soft competition on different feature sets. The proposed architecture is interpreted as a generalized finite mixture model and, therefore, parameter estimation is treated as a maximum likelihood problem. An EM algorithm is derived for parameter estimation and, moreover, a model selection method is proposed to fit the proposed architecture to a specific problem. Comparative results are presented for the real world problem of speaker identification.
15908834
Ensemble Learning with Active Data Selection for Semi-Supervised Pattern Classification
Unlike traditional pattern classification, semi-supervised learning provides a novel technique to make use of both labeled and unlabeled data for improving the performance of classification. In general, there are two critical issues for semi-supervised learning of discriminative classifiers; i.e., how to create an initial classifier of a good generalization capability with the limited labeled data and the how to make an effective use of unlabeled data without degradation of the established classifier. To tackle two aforementioned problems, we propose an ensemble learning approach based on a recent active data selection strategy, where ensemble learning would yield good generalization and active data selection tends to choose the unlabeled data more likely resulting in an improvement during semi-supervised learning. By using an ensemble of K-NN classifiers, we demonstrate the effectiveness of our approach on a synthetic data classification and a facial expression recognition tasks.
6083596
Improved learning algorithms for mixture of experts in multiclass classification
Mixture of experts (ME) is a modular neural network architecture for supervised learning. A double-loop Expectation-Maximization (EM) algorithm has been introduced to the ME architecture for adjusting the parameters and the iteratively reweighted least squares (IRLS) algorithm is used to perform maximization in the inner loop [Jordan, M.I., Jacobs, R.A. (1994). Hierarchical mixture of experts and the EM algorithm, Neural Computation, 6(2), 181-214]. However, it is reported in literature that the IRLS algorithm is of instability and the ME architecture trained by the EM algorithm, where IRLS algorithm is used in the inner loop, often produces the poor performance in multiclass classification. In this paper, the reason of this instability is explored. We find out that due to an implicitly imposed incorrect assumption on parameter independence in multiclass classification, an incomplete Hessian matrix is used in that IRLS algorithm. Based on this finding, we apply the Newton-Raphson method to the inner loop of the EM algorithm in the case of multiclass classification, where the exact Hessian matrix is adopted. To tackle the expensive computation of the Hessian matrix and its inverse, we propose an approximation to the Newton-Raphson algorithm based on a so-called generalized Bernoulli density. The Newton-Raphson algorithm and its approximation have been applied to synthetic data, benchmark, and real-world multiclass classification tasks. For comparison, the IRLS algorithm and a quasi-Newton algorithm called BFGS have also been applied to the same tasks. Simulation results have shown that the use of the proposed learning algorithms avoids the instability problem and makes the ME architecture produce good performance in multiclass classification. In particular, our approximation algorithm leads to fast learning. In addition, the limitation of our approximation algorithm is also empirically investigated in this paper.
34883067
Personalized News Reading via Hybrid Learning
In this paper, we present a personalized news reading prototype where latest news articles published by various on-line news providers are automatically collected, categorized and ranked in light of a user’s habits or interests. Moreover, our system can adapt itself towards a better performance. In order to develop such an adaptive system, we proposed a hybrid learning strategy; supervised learning is used to create an initial system configuration based on user’s feedbacks during registration, while an unsupervised learning scheme gradually updates the configuration by tracing the user’s behaviors as the system is being used. Simulation results demonstrate satisfactory performance.
205413619
An efficient preconditioned iterative solver for solving a coupled fluid structure interaction problem
Modelling the interaction of an acoustic field in a fluid and an elastic structure submerged in the fluid leads to a system of complex linear equations with a complicated sparsity structure and, for higher wavenumbers and adequate modelling, the systems are very large. Direct methods are not practical. Preconditioned iterative methods, which are suitable for single operator equations, are not immediately applicable to the coupled case. This article proposes a block diagonal preconditioner of the sparse approximate inverse (SPAI) type that can accelerate the convergence of Krylov iterative solvers for the coupled system. Moreover, the proposed preconditioner can properly and implicitly scale the coupled matrix. Some numerical results are presented to demonstrate the effectiveness of the new method.
16722943
The Euclidean Orienteering Problem Revisited
We consider the rooted orienteering problem: Given a set $P$ of $n$ points in the plane, a starting point $r \in P$, and a length constraint $B$, one needs to find a path starting from $r$ that visits as many points of $P$ as possible and of length not exceeding $B$. We present a $(1-\varepsilon)$-approximation algorithm for this problem that runs in $n^{O(1/\varepsilon)}$ time; the computed path visits at least $ (1-\varepsilon)k_{\mathrm{opt}}$ points of $P$, where $k_{\mathrm{opt}}$ is the number of points visited by an optimal solution. This is the first polynomial time approximation scheme for this problem. The algorithm also works in higher dimensions.
1213875
A simplified LVI-based primal-dual neural network for repetitive motion planning of PA10 robot manipulator starting from different initial states
This paper presents a simplified primal-dual neural network based on linear variational inequalities (LVI) for online repetitive motion planning of PA10 robot manipulator. To do this, a drift-free criterion is exploited in the form of a quadratic function. In addition, the repetitive-motion-planning scheme could incorporate the joint limits and joint velocity limits simultaneously. Such a scheme is finally reformulated as a time-varying quadratic program (QP). As a QP real-time solver, the simplified LVI-based primal-dual neural network (LVI-PDNN) is designed based on the QP-LVI conversion and Karush-Kuhn-Tucker (KKT) conditions. It has a simple piecewise-linear dynamics and could globally exponentially converge to the optimal solution of strictly-convex quadratic-programs. The simplified LVI-PDNN model is simulated based on PA10 robot arm, and simulation results show the effective remedy of the joint angle drift problem of PA10 robot.
16708333
MATLAB Simulation and Comparison of Zhang Neural Network and Gradient Neural Network for Time-Varying Lyapunov Equation Solving
This paper presents a new kind of recurrent neural network proposed by Zhang et al.for solving online Lyapunov equation with time-varying coefficient matrices. Global exponential convergence could be achieved by such a recurrent neural network when solving the time-varying problems in comparison with gradient neural networks (GNN). MATLAB simulation of both neural networks for the real-time solution of time-varying Lyapunov equation is then investigated through several important techniques. Computer-simulation results substantiate the theoretical analysis and demonstrate the efficacy of such a Zhang neural network (ZNN) on time-varying Lyapunov equation solving, especially when using power-sigmoid activation functions.
18102767
Resilient Rights Protection for Product Data
With the development of advance manufacture applications, enterprise must interact with their suppliers and customers to share more product data information. Consequently, copyright and integrity protection over product data is becoming an urgent requirement. Product data information consists of two parts: product structure and part content, besides protecting the three-dimensional (3D) model of part by watermarking, we also need to protect product structure information, which describes the relations among product parts and can be represented as a tree. In this paper, based on the 3D polygonal meshes watermark technology, the structure/semi-structure data watermark technologies and the idea of Fractal, we propose a novel watermark scheme for tree-structure product data with the value lying both in product structure and in part node content, which gives a more comprehensive and resilient right protection for both part node content and product structure. Moreover it is particularly effective when resisting invertibility attacks