The balance of exploration versus exploitation (EvE) is a key issue on evolutionary computation. In this paper we will investigate how an adaptive controller aimed to perform Operator Selection can be used to dynamically manage the EvE balance required by the search, showing that the search strategies determined by this control paradigm lead to an improvement of solution quality found by the evolutionary algorithm.
Parameter setting is an important challenge for building efficient and robust EAs. As mentioned in the introduction, using an EA requires us to define its basic structural components and to set the values of its behavioral parameters. The components may be considered as structural parameters of the algorithm. Therefore, parameter setting in EA addresses two general classes of parameters: and (alternatively, the terms and parameters are used ). Concerning structural parameters, automated tuning techniques can be used as tools for selecting the initial configuration of the algorithm. The configuration and the discovery of new heuristics from building blocks is also addressed by the concept of hyperheuristics . We may also mention self-adpative operators that mainly consists in encoding directly the parameters of the oprator in the individuals. This approach also allows the algorithm to dynamically manage the EvE balanceand has been successfully applied for solving combinatorial and continous optimization problems @cite_1 @cite_2 @cite_0 @cite_3 . Note that an adaptive management of the operators, which dynamically adds and discards operators during the search, has been proposed by .
@cite_0 @cite_1 @cite_3 @cite_2
2137340504 1977474365 2123497782 2152028815
Differential evolution (DE) is an efficient and powerful population-based stochastic search technique for solving optimization problems over continuous space, which has been widely applied in many scientific and engineering fields. However, the success of DE in solving a specific problem crucially depends on appropriately choosing trial vector generation strategies and their associated control parameter values. Employing a trial-and-error scheme to search for the most suitable strategy and its associated parameter settings requires high computational costs. Moreover, at different stages of evolution, different strategies coupled with different parameter settings may be required in order to achieve the best performance. In this paper, we propose a self-adaptive DE (SaDE) algorithm, in which both trial vector generation strategies and their associated control parameter values are gradually self-adapted by learning from their previous experiences in generating promising solutions. Consequently, a more suitable generation strategy along with its parameter settings can be determined adaptively to match different phases of the search process evolution. The performance of the SaDE algorithm is extensively evaluated (using codes available from P. N. Suganthan) on a suite of 26 bound-constrained numerical optimization problems and compares favorably with the conventional DE and several state-of-the-art parameter adaptive DE variants. Several techniques have been proposed to tackle the Adaptive Operator Selection (AOS) issue in Evolutionary Algorithms. Some recent proposals are based on the Multi-armed Bandit (MAB) paradigm: each operator is viewed as one arm of a MAB problem, and the rewards are mainly based on the fitness improvement brought by the corresponding operator to the individual it is applied to. However, the AOS problem is dynamic, whereas standard MAB algorithms are known to optimally solve the exploitation versus exploration trade-off in static settings. An original dynamic variant of the standard MAB Upper Confidence Bound algorithm is proposed here, using a sliding time window to compute both its exploitation and exploration terms. In order to perform sound comparisons between AOS algorithms, artificial scenarios have been proposed in the literature. They are extended here toward smoother transitions between different reward settings. The resulting original testbed also includes a real evolutionary algorithm that is applied to the well-known Royal Road problem. It is used here to perform a thorough analysis of the behavior of AOS algorithms, to assess their sensitivity with respect to their own hyper-parameters, and to propose a sound comparison of their performances. Recently, the hybridization between evolutionary algorithms and other metaheuristics has shown very good performances in many kinds of multiobjective optimization problems (MOPs), and thus has attracted considerable attentions from both academic and industrial communities. In this paper, we propose a novel hybrid multiobjective evolutionary algorithm (HMOEA) for real-valued MOPs by incorporating the concepts of personal best and global best in particle swarm optimization and multiple crossover operators to update the population. One major feature of the HMOEA is that each solution in the population maintains a nondominated archive of personal best and the update of each solution is in fact the exploration of the region between a selected personal best and a selected global best from the external archive. Before the exploration, a selfadaptive selection mechanism is developed to determine an appropriate crossover operator from several candidates so as to improve the robustness of the HMOEA for different instances of MOPs. Besides the selection of global best from the external archive, the quality of the external archive is also considered in the HMOEA through a propagating mechanism. Computational study on the biobjective and three-objective benchmark problems shows that the HMOEA is competitive or superior to previous multiobjective algorithms in the literature. This paper studies a challenging problem of dynamic scheduling in steelmaking-continuous casting (SCC) production. The problem is to re-optimize the assignment, sequencing, and timetable of a set of existing and new jobs among various production stages for the new environment when unforeseen changes occur in the production system. We model the problem considering the constraints of the practical technological requirements and the dynamic nature. To solve the SCC scheduling problem, we propose an improved differential evolution (DE) algorithm with a real-coded matrix representation for each individual of the population, a two-step method for generating the initial population, and a new mutation strategy. To further improve the efficiency and effectiveness of the solution process for dynamic use, an incremental mechanism is proposed to generate a new initial population for the DE whenever a real-time event arises, based on the final population in the last DE solution process. Computational experiments on randomly generated instances and the practical production data show that the proposed improved algorithm can obtain better solutions compared to other algorithms.