1739
Evolutionary design of artificial neural networks with different nodes
Evolutionary design of artificial neural networks (ANNs) offers a very promising and automatic alternative to designing ANNs manually. The advantage of evolutionary design over the manual design is their adaptability to a dynamic environment. Most research in evolving ANNs only deals with the topological structure of ANNs and little has been done on the evolution of both topological structures and node transfer functions. The paper presents a new automatic method to design general neural networks (GNNs) with different nodes. GNNs combine generalisation capabilities of distributed neural networks (DNNs) and computational efficiency of local neural networks (LNNs). We use an evolutionary programming (EP) algorithm with new mutation operators which are very effective for evolving GNN architectures and weights simultaneously. Our EP algorithm allows GNNs to grow as well as shrink during the evolutionary process. Our experiment results show the effectiveness and accuracy of evolved GNNs.
16112032
Fast Evolution Strategies
Evolution strategies are a class of general optimisation algorithms which are applicable to functions that are multimodal, non-differentiable, or even discontinuous. Although recombination operators have been introduced into evolution strategies, their primary search operator is still mutation. Classical evolution strategies rely on Gaussian mutations. A new mutation operator based on the Cauchy distribution is proposed in this paper. It is shown empirically that the new evolution strategy based on Cauchy mutation outperforms the classical evolution strategy on most of the 23 benchmark problems tested in this paper. These results, along with those obtained by fast evolutionary programming
18179447
Towards Designing Neural Network Ensembles by Evolution
This paper proposes a co-evolutionary learning system, i.e., CELS, to design neural network (NN) ensembles. CELS addresses the issue of automatic determination of the number of individual NNs in an ensemble and the exploitation of the interaction between individual NN design and combination. The idea of CELS is to encourage different individual NNs in the ensemble to learn different parts or aspects of the training data so that the ensemble can learn the whole training data better. The cooperation and specialisation among different individual NNs are considered during the individual NN design. This provides an opportunity for different NNs to interact with each other and to specialise. Experiments on two real-world problems demonstrate that CELS can produce NN ensembles with good generalisation ability.
9804135
EPNet for Chaotic Time-Series Prediction
EPNet is an evolutionary system for automatic design of artificial neural networks (ANNs) [1, 2, 3]. Unlike most previous methods on evolving ANNs, EPNet puts its emphasis on evolving ANN'S behaviours rather than circuitry. The parsimony of evolved ANNs is encouraged by the sequential application of architectural mutations. In this paper, EP Net is applied to a couple of chaotic time-series prediction problems (i.e., the Mackey-Glass differential equation and the logistic map). The experimental results show that EPNet can produce very compact ANNs with good prediction ability in comparison with other algorithms.
15370058
Evolutionary programming made faster
Evolutionary programming (EP) has been applied with success to many numerical and combinatorial optimization problems in recent years. EP has rather slow convergence rates, however, on some function optimization problems. In the paper, a "fast EP" (FEP) is proposed which uses a Cauchy instead of Gaussian mutation as the primary search operator. The relationship between FEP and classical EP (CEP) is similar to that between fast simulated annealing and the classical version. Both analytical and empirical studies have been carried out to evaluate the performance of FEP and CEP for different function optimization problems. The paper shows that FEP is very good at search in a large neighborhood while CEP is better at search in a small local neighborhood. For a suite of 23 benchmark problems, FEP performs much better than CEP for multimodal functions with many local minima while being comparable to CEP in performance for unimodal and multimodal functions with only a few local minima. The paper also shows the relationship between the search step size and the probability of finding a global optimum and thus explains why FEP performs better than CEP on some functions but not on others. In addition, the importance of the neighborhood size and its relationship to the probability of finding a near-optimum is investigated. Based on these analyses, an improved FEP (IFEP) is proposed and tested empirically. This technique mixes different search operators (mutations). The experimental results show that IFEP performs better than or as well as the better of FEP and CEP for most benchmark problems tested.
45330274
Time Series Prediction by Using Negatively Correlated Neural Networks
Negatively correlated neural networks (NCNNs) have been proposed to design neural network (NN) ensembles [1]. The idea of NCNNs is to encourage different individual NNs in the ensemble to learn different parts or aspects of a training data so that the ensemble can learn the whole training data better. The cooperation and specialisation among different individual NNs are considered during the individual NN design. This provides an opportunity for different NNs to interact with each other and to specialise. In this paper, NCNNs are applied to two time series prediction problems (i.e., the Mackey-Glass differential equation and the chlorophyll-a prediction in Lake Kasumigaura). The experimental results show that NCNNs can produce NN ensembles with good generalisation ability.
5940493
Efficient schema design for a pharmaceutical data repository
Large scientific databases often consist of heterogeneous components that differ in the number of attributes and the number of tuples. In this paper, we show that increased performance is achieved when a complex schema is used to represent different components of a data repository. The driving application used in this study is a pharmaceutical drug repository. The types of access patterns associated with this repository consist of the retrieval of a selected set of attribute values for a consecutive or a random set of tuples. These consecutive and random access patterns, which are typical of a drug discovery experiment, are used to measure the data retrieval throughput for different schemas.
15500512
Real-time simulation of physically based on-surface flow
Although many papers have been published in the field of fluid simulation, little attention has been paid to on-surface flow involving wetting and stain transportation as well as erosion and deposition phenomena. In this paper, we introduce nonzero divergence in the mass equation of Navier–Stokes equations to simulate water penetration from on-surface flow into substrate material. Also, the volume of fluid method is adopted to track the free surface. With a computation of the actual amount of absorbed water we render the wetting effects with fully dry and fully wet texture images simultaneously. Using our model, the on-surface flow that accompanies water absorption can be simulated realistically in real time with OpenGL preview rendering. Experimental results illustrate that our model can be widely applied to solve various problems related to on-surface flow.
13883054
Dynamic Programming via Static Incrementalization
Dynamic programming is an important algorithm design technique. It is used for solving problems whose solutions involve recursively solving subproblems that share subsubproblems. While a straightforward recursive program solves common subsubproblems repeatedly and often takes exponential time, a dynamic programming algorithm solves every subsubproblem just once, saves the result, reuses it when the subsubproblem is encountered again, and takes polynomial time. This paper describes a systematic method for transforming programs written as straightforward recursions into programs that use dynamic programming. The method extends the original program to cache all possibly computed values, incrementalizes the extended program with respect to an input increment to use and maintain all cached results, prunes out cached results that are not used in the incremental computation, and uses the resulting incremental program to form an optimized new program. Incrementalization statically exploits semantics of both control structures and data structures and maintains as invariants equalities characterizing cached results. The principle underlying incrementalization is general for achieving drastic program speedups. Compared with previous methods that perform memoization or tabulation, the method based on incrementalization is more powerful and systematic. It has been implemented and applied to numerous problems and succeeded on all of them.
30635259
On global exponential stability of generalized stochastic neural networks with mixed time-delays
Abstract This paper is concerned with the global exponential stability analysis problem for a general class of stochastic neural networks with mixed time-delays. The mixed time-delays under consideration comprise both the discrete time-varying delays and the distributed time-delays. The main purpose of this paper is to establish easily verifiable conditions under which the delayed stochastic neural network is exponentially stable in the mean square in the presence of both the discrete and distributed delays. By employing a new Lyapunov–Krasovskii functional and conducting stochastic analysis, a linear matrix inequality (LMI) approach is developed to derive the criteria of the exponential stability. Furthermore, the main results are specialized to deal with the analysis problem for the global asymptotic stability within the same LMI framework. The proposed criteria can be readily checked by using some standard numerical packages such as the Matlab LMI toolbox. A simple example is provided to demonstrate the effectiveness and applicability of the proposed testing criteria.
3748150
Mesh blending
A new method for smoothly connecting different patches on triangle meshes with arbitrary connectivity, called mesh blending, is presented. A major feature of mesh blending is to move vertices of the blending region to a virtual blending surface by choosing an appropriate parameterization of those vertices. Once blending is completed, the parameterization optimization is performed to perfect the final meshes. Combining mesh blending with multiresolution techniques, an effective blending technique for meshes is obtained. Our method has several advantages: (1) the user can intuitively control the blending result using different blending radii, (2) the shape of cross-section curves can be adjusted to flexibly design complex models, and (3) the resulting mesh has the same connectivity as the original mesh. In this paper, some examples about smoothing, sharpening, and mesh editing show the efficiency of the method.