TL;DR: Practical design-guidelines for developing efficient genetic algorithms to successfully solve real-world problems are offered and a practical population-sizing model is presented and verified.
Abstract: This paper offers practical design-guidelines for developing efficient genetic algorithms (GAs) to successfully solve real-world problems. As an important design component, a practical population-sizing model is presented and verified.
TL;DR: This paper attempts to provide a comprehensive overview of the related work within a unified framework on addressing different uncertainties in evolutionary computation, which has been scattered in a variety of research areas.
Abstract: Evolutionary algorithms often have to solve optimization problems in the presence of a wide range of uncertainties. Generally, uncertainties in evolutionary computation can be divided into the following four categories. First, the fitness function is noisy. Second, the design variables and/or the environmental parameters may change after optimization, and the quality of the obtained optimal solution should be robust against environmental changes or deviations from the optimal point. Third, the fitness function is approximated, which means that the fitness function suffers from approximation errors. Fourth, the optimum of the problem to be solved changes over time and, thus, the optimizer should be able to track the optimum continuously. In all these cases, additional measures must be taken so that evolutionary algorithms are still able to work satisfactorily. This paper attempts to provide a comprehensive overview of the related work within a unified framework, which has been scattered in a variety of research areas. Existing approaches to addressing different uncertainties are presented and discussed, and the relationship between the different categories of uncertainties are investigated. Finally, topics for future research are suggested.
TL;DR: In this paper, a modified particle swarm optimization (MPSO) was proposed to deal with the equality and inequality constraints in the economic dispatch (ED) problems with nonsmooth cost functions.
Abstract: This work presents a new approach to economic dispatch (ED) problems with nonsmooth cost functions using a particle swarm optimization (PSO) technique. The practical ED problems have nonsmooth cost functions with equality and inequality constraints that make the problem of finding the global optimum difficult using any mathematical approaches. A modified PSO (MPSO) mechanism is suggested to deal with the equality and inequality constraints in the ED problems. A constraint treatment mechanism is devised in such a way that the dynamic process inherent in the conventional PSO is preserved. Moreover, a dynamic search-space reduction strategy is devised to accelerate the optimization process. To show its efficiency and effectiveness, the proposed MPSO is applied to test ED problems, one with smooth cost functions and others with nonsmooth cost functions considering valve-point effects and multi-fuel problems. The results of the MPSO are compared with the results of conventional numerical methods, Tabu search method, evolutionary programming approaches, genetic algorithm, and modified Hopfield neural network approaches.
TL;DR: How heuristic methods should be evaluated and proposed using the concept of Pareto optimality in the comparison of different heuristic approaches are discussed.
Abstract: This paper presents a survey of the research on the vehicle routing problem with time windows (VRPTW). The VRPTW can be described as the problem of designing least cost routes from one depot to a set of geographically scattered points. The routes must be designed in such a way that each point is visited only once by exactly one vehicle within a given time interval, all routes start and end at the depot, and the total demands of all points on one particular route must not exceed the capacity of the vehicle. Both traditional heuristic route construction methods and recent local search algorithms are examined. The basic features of each method are described, and experimental results for Solomon's benchmark test problems are presented and analyzed. Moreover, we discuss how heuristic methods should be evaluated and propose using the concept of Pareto optimality in the comparison of different heuristic approaches. The metaheuristic methods are described in the second part of this article.
TL;DR: This paper describes how to construct a GA and the main strands of GA theory before speculatively identifying possible applications of GAs to the study of immunology.
TL;DR: In this article, a multiobjective formulation for the siting and sizing of DG resources into existing distribution networks is proposed, which permits the planner to decide the best compromise between cost of network upgrading, cost of power losses, and cost of energy not supplied.
Abstract: In the restructured electricity industry, the engineering aspects of planning need to be reformulated even though the goal to attain remains substantially the same, requiring various objectives to be simultaneously accomplished to achieve the optimality of the power system development and operation. In many cases, these objectives contradict each other and cannot be handled by conventional single optimization techniques. In this paper, a multiobjective formulation for the siting and sizing of DG resources into existing distribution networks is proposed. The methodology adopted permits the planner to decide the best compromise between cost of network upgrading, cost of power losses, cost of energy not supplied, and cost of energy required by the served customers. The implemented technique is based on a genetic algorithm and an /spl epsiv/-constrained method that allows obtaining a set of noninferior solutions. Application examples are presented to demonstrate the effectiveness of the proposed procedure.
TL;DR: Past research is extended by providing an advanced, genetic algorithm based, multilayered structural optimization strategy that can assist both in the proper representation of traffic flow data with temporal and spatial characteristics as well as in the selection of the appropriate neural network structure.
Abstract: Short-term forecasting of traffic parameters such as flow and occupancy is an essential element of modern Intelligent Transportation Systems research and practice. Although many different methodologies have been used for short-term predictions, literature suggests neural networks as one of the best alternatives for modeling and predicting traffic parameters. However, because of limited knowledge regarding a network’s optimal structure given a specific dataset, researchers have to rely on time consuming and questionably efficient rules-of-thumb when developing them. This paper extends past research by providing an advanced, genetic algorithm based, multilayered structural optimization strategy that can assist both in the proper representation of traffic flow data with temporal and spatial characteristics as well as in the selection of the appropriate neural network structure. Further, it evaluates the performance of the developed network by applying it to both univariate and multivariate traffic flow data from an urban signalized arterial. The results show that the capabilities of a simple static neural network, with genetically optimized step size, momentum and number of hidden units, are very satisfactory when modeling both univariate and multivariate traffic data.
TL;DR: This paper presents a hybrid genetic algorithm for the job shop scheduling problem that is based on random keys and tested on a set of standard instances taken from the literature and compared with other approaches.
TL;DR: A collection of test problems, some are better known than others, provides an easily accessible collection of standard test problems for continuous global optimization and investigates the microscopic behavior of the algorithms through quartile sequential plots.
Abstract: There is a need for a methodology to fairly compare and present evaluation study results of stochastic global optimization algorithms. This need raises two important questions of (i) an appropriate set of benchmark test problems that the algorithms may be tested upon and (ii) a methodology to compactly and completely present the results. To address the first question, we compiled a collection of test problems, some are better known than others. Although the compilation is not exhaustive, it provides an easily accessible collection of standard test problems for continuous global optimization. Five different stochastic global optimization algorithms have been tested on these problems and a performance profile plot based on the improvement of objective function values is constructed to investigate the macroscopic behavior of the algorithms. The paper also investigates the microscopic behavior of the algorithms through quartile sequential plots, and contrasts the information gained from these two kinds of plots. The effect of the length of run is explored by using three maximum numbers of function evaluations and it is shown to significantly impact the behavior of the algorithms.
TL;DR: In this article, an improved genetic algorithm with multiplier updating (IGA/spl I.bar/MU) was proposed to solve power economic dispatch (PED) problems of units with valve-point effects and multiple fuels.
Abstract: This paper presents an improved genetic algorithm with multiplier updating (IGA/spl I.bar/MU) to solve power economic dispatch (PED) problems of units with valve-point effects and multiple fuels. The proposed IGA/spl I.bar/MU integrates the improved genetic algorithm (IGA) and the multiplier updating (MU). The IGA equipped with an improved evolutionary direction operator and a migration operation can efficiently search and actively explore solutions, and the MU is employed to handle the equality and inequality constraints of the PED problem. Few PED problem-related studies have seldom addressed both valve-point loadings and change fuels. To show the advantages of the proposed algorithm, which was applied to test PED problems with one example considering valve-point effects, one example considering multiple fuels, and one example addressing both valve-point effects and multiple fuels. Additionally, the proposed algorithm was compared with previous methods and the conventional genetic algorithm (CGA) with the MU (CGA/spl I.bar/MU), revealing that the proposed IGA/spl I.bar/MU is more effective than previous approaches, and applies the realistic PED problem more efficiently than does the CGA/spl I.bar/MU. Especially, the proposed algorithm is highly promising for the large-scale system of the actual PED operation.
TL;DR: This study proposes a novel learning method that is able to generate FCM models from input historical data, and without human intervention, based on genetic algorithms, and requires only a single state vector sequence as an input.
TL;DR: A PV-Diesel system optimised by HOGA is compared with a stand-alone PV-only system that has been dimensioned using a classical design method based on the available energy under worst-case conditions, where the demand and the solar irradiation are the same.
TL;DR: Why and when the multiobjective approach to constraint handling is expected to work or fail is analyzed and an improved evolutionary algorithm based on evolution strategies and differential variation is proposed.
Abstract: A common approach to constraint handling in evolutionary optimization is to apply a penalty function to bias the search toward a feasible solution. It has been proposed that the subjective setting of various penalty parameters can be avoided using a multiobjective formulation. This paper analyzes and explains in depth why and when the multiobjective approach to constraint handling is expected to work or fail. Furthermore, an improved evolutionary algorithm based on evolution strategies and differential variation is proposed. Extensive experimental studies have been carried out. Our results reveal that the unbiased multiobjective approach to constraint handling may not be as effective as one may have assumed.
TL;DR: This paper identifies shortcomings associated with the existing test functions of novel hybrid benchmark functions, whose complexity and properties can be controlled easily, are introduced and several evolutionary algorithms are evaluated with the novel test functions.
Abstract: In the evolutionary optimization field, there exist some algorithms taking advantage of the known property of the benchmark functions, such as local optima lying along the coordinate axes, global optimum having the same values for many variables and so on. Multiagent genetic algorithm (MAGA) is an example for this class of algorithms. In this paper, we identify shortcomings associated with the existing test functions. Novel hybrid benchmark functions, whose complexity and properties can be controlled easily, are introduced and several evolutionary algorithms are evaluated with the novel test functions.
TL;DR: This paper studies static and dynamic decentralized versions of the search model known as cellular genetic algorithm (cGA), in which individuals are located in a specific topology and interact only with their neighbors and concludes that dynamic cGAs have the most desirable behavior among all the evaluated ones in terms of efficiency and accuracy.
Abstract: This paper studies static and dynamic decentralized versions of the search model known as cellular genetic algorithm (cGA), in which individuals are located in a specific topology and interact only with their neighbors. Making changes in the shape of such topology or in the neighborhood may give birth to a high number of algorithmic variants. We perform these changes in a methodological way by tuning the concept of ratio. Since the relationship (ratio) between the topology and the neighborhood shape defines the search selection pressure, we propose to analyze in depth the influence of this ratio on the exploration/exploitation tradeoff. As we will see, it is difficult to decide which ratio is best suited for a given problem. Therefore, we introduce a preprogrammed change of this ratio during the evolution as a possible additional improvement that removes the need of specifying a single ratio. A later refinement will lead us to the first adaptive dynamic kind of cellular models to our knowledge. We conclude that these dynamic cGAs have the most desirable behavior among all the evaluated ones in terms of efficiency and accuracy; we validate our results on a set of seven different problems of considerable complexity in order to better sustain our conclusions.
TL;DR: This paper presents a simple approach to evolutionary multi-objective optimization, using the PS-EA algorithm for multi-Criteria Optimization of Finite State Automata.
Abstract: Evolutionary Multiobjective Optimization Recent Trends in Evolutionary Multiobjective Optimization Self-adaptation and Convergence of Multiobjective Evolutionary Algorithms in Continuous Search Spaces A simple approach to evolutionary multi-objective optimization Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Scalable Test Problems for Evolutionary Multi-Objective Optimization Particle Swarm Inspired Evolutionary Algorithm (PS-EA) for Multi-Criteria Optimization Problems Evolving Continuous Pareto Regions MOGADES: Multi-Objective Genetic Algorithm with Distributed Environment Scheme Use of Multiobjective Optimization Concepts to Handle Constraints in Genetic Algorithms Multi- Criteria Optimization of Finite State Automata: Maximizing Performance while Minimizing Description Length Multi-objective Optimization of Space Structures under Static and Seismic Loading Conditions
TL;DR: In this paper, a GA optimization technique is applied to determine the switching angles for a cascaded multilevel inverter which eliminates specified higher order harmonics while maintaining the required fundamental voltage.
Abstract: In this letter, a genetic algorithm (GA) optimization technique is applied to determine the switching angles for a cascaded multilevel inverter which eliminates specified higher order harmonics while maintaining the required fundamental voltage. This technique can be applied to multilevel inverters with any number of levels. As an example, in this paper a seven-level inverter is considered, and the optimum switching angles are calculated offline to eliminate the fifth and seventh harmonics. These angles are then used in an experimental setup to validate the results.
TL;DR: Inspired by the natural features of the variable size of the population, a variable population-size genetic algorithm (VPGA) is presented by introducing the ''dying probability'' for the individuals and the ''war/disease process'' forThe population.
TL;DR: This research shows that as the uncertainty in the travel time information increases, a dynamic routing strategy that takes the real-time traffic information into account becomes increasingly superior to a static one.
TL;DR: The Gaussian process model is described and proposed using it as an inexpensive fitness function surrogate and clearly outperforms other evolutionary strategies on standard test functions as well as on a real-world problem: the optimization of stationary gas turbine compressor profiles.
Abstract: We present an overview of evolutionary algorithms that use empirical models of the fitness function to accelerate convergence, distinguishing between evolution control and the surrogate approach. We describe the Gaussian process model and propose using it as an inexpensive fitness function surrogate. Implementation issues such as efficient and numerically stable computation, exploration versus exploitation, local modeling, multiple objectives and constraints, and failed evaluations are addressed. Our resulting Gaussian process optimization procedure clearly outperforms other evolutionary strategies on standard test functions as well as on a real-world problem: the optimization of stationary gas turbine compressor profiles.
TL;DR: This paper presents a new approach to the problem of activity-based demand generation, which uses genetic algorithms (GA), which keeps, for each member of the population, several instances of possible all-day activity plans in memory.
Abstract: Activity-based demand generation contructs complete all-day activity plans for each member of a population, and derives transportation demand from the fact that consecutive activities at different locations need to be connected by travel. Besides many other advantages, activity-based demand generation also fits well into the paradigm of multi-agent simulation, where each traveler is kept as an individual throughout the whole modeling process. In this paper, we present a new approach to the problem, which uses genetic algorithms (GA). Our GA keeps, for each member of the population, several instances of possible all-day activity plans in memory. Those plans are modified by mutation and crossover, while ‘bad’ instances are eventually discarded. Any GA needs a fitness function to evaluate the performance of each instance. For all-day activity plans, it makes sense to use a utility function to obtain such a fitness. In consequence, a significant part of the paper is spent discussing such a utility function. In addition, the paper shows the performance of the algorithm to a few selected problems, including very busy and rather non-busy days.
TL;DR: A new dynamic problem generator that can create required dynamics from any binary-encoded stationary problem is also formalized and inspired by the complementarity mechanism in nature a Dual PBIL is proposed, which operates on two probability vectors that are dual to each other with respect to the central point in the genotype space.
Abstract: Evolutionary algorithms have been widely used for stationary optimization problems. However, the environments of real world problems are often dynamic. This seriously challenges traditional evolutionary algorithms. In this paper, the application of population-based incremental learning (PBIL) algorithms, a class of evolutionary algorithms, for dynamic problems is investigated. Inspired by the complementarity mechanism in nature a Dual PBIL is proposed, which operates on two probability vectors that are dual to each other with respect to the central point in the genotype space. A diversity maintaining technique of combining the central probability vector into PBIL is also proposed to improve PBIL’s adaptability in dynamic environments. In this paper, a new dynamic problem generator that can create required dynamics from any binary-encoded stationary problem is also formalized. Using this generator, a series of dynamic problems were systematically constructed from several benchmark stationary problems and an experimental study was carried out to compare the performance of several PBIL algorithms and two variants of standard genetic algorithm. Based on the experimental results, we carried out algorithm performance analysis regarding the weakness and strength of studied PBIL algorithms and identified several potential improvements to PBIL for dynamic optimization problems.
TL;DR: This work presents both application and comparison of the metaheuristic techniques to generation expansion planning (GEP) problem and the effectiveness of each proposed methods has been illustrated in detail.
Abstract: This work presents both application and comparison of the metaheuristic techniques to generation expansion planning (GEP) problem. The Metaheuristic techniques such as the genetic algorithm, differential evolution, evolutionary programming, evolutionary strategy, ant colony optimization, particle swarm optimization, tabu search, simulated annealing, and hybrid approach are applied to solve GEP problem. The original GEP problem is modified using the proposed methods virtual mapping procedure (VMP) and penalty factor approach (PFA), to improve the efficiency of the metaheuristic techniques. Further, intelligent initial population generation (IIPG), is introduced in the solution techniques to reduce the computational time. The VMP, PFA, and IIPG are used in solving all the three test systems. The GEP problem considered synthetic test systems for 6-year, 14-year, and 24-year planning horizon having five types of candidate units. The results obtained by all these proposed techniques are compared and validated against conventional dynamic programming and the effectiveness of each proposed methods has also been illustrated in detail.
TL;DR: A hybrid algorithm of two fuzzy genetics-based machine learning approaches (i.e., Michigan and Pittsburgh) for designing fuzzy rule-based classification systems is proposed and shows that the hybrid algorithm has higher search ability.
Abstract: We propose a hybrid algorithm of two fuzzy genetics-based machine learning approaches (i.e., Michigan and Pittsburgh) for designing fuzzy rule-based classification systems. First, we examine the search ability of each approach to efficiently find fuzzy rule-based systems with high classification accuracy. It is clearly demonstrated that each approach has its own advantages and disadvantages. Next, we combine these two approaches into a single hybrid algorithm. Our hybrid algorithm is based on the Pittsburgh approach where a set of fuzzy rules is handled as an individual. Genetic operations for generating new fuzzy rules in the Michigan approach are utilized as a kind of heuristic mutation for partially modifying each rule set. Then, we compare our hybrid algorithm with the Michigan and Pittsburgh approaches. Experimental results show that our hybrid algorithm has higher search ability. The necessity of a heuristic specification method of antecedent fuzzy sets is also demonstrated by computational experiments on high-dimensional problems. Finally, we examine the generalization ability of fuzzy rule-based classification systems designed by our hybrid algorithm.
TL;DR: A new, hybrid genetic algorithm (GA) technique, including hill climbing and parallel-migration, combined with a new, robust evaluation metric based on surface interpenetration is presented, which offers much faster convergence than prior GA methods and ensures more precise alignments, even in the presence of significant noise, than mean squared error or other well-known robust cost functions.
Abstract: This paper addresses the range image registration problem for views having low overlap and which may include substantial noise. The current state of the art in range image registration is best represented by the well-known iterative closest point (ICP) algorithm and numerous variations on it. Although this method is effective in many domains, it nevertheless suffers from two key limitations: it requires prealignment of the range surfaces to a reasonable starting point; and it is not robust to outliers arising either from noise or low surface overlap. This paper proposes a new approach that avoids these problems. To that end, there are two key, novel contributions in this work: a new, hybrid genetic algorithm (GA) technique, including hill climbing and parallel-migration, combined with a new, robust evaluation metric based on surface interpenetration. Up to now, interpenetration has been evaluated only qualitatively; we define the first quantitative measure for it. Because they search in a space of transformations, GA are capable of registering surfaces even when there is low overlap between them and without need for prealignment. The novel GA search algorithm we present offers much faster convergence than prior GA methods, while the new robust evaluation metric ensures more precise alignments, even in the presence of significant noise, than mean squared error or other well-known robust cost functions. The paper presents thorough experimental results to show the improvements realized by these two contributions.
TL;DR: An evolutionary-based approach to solve engineering design problems without using penalty functions is proposed and tested with respect to typical penalty function techniques as well as against state-of-the-art approaches using four mechanical design problems.
Abstract: We propose an evolutionary-based approach to solve engineering design problems without using penalty functions. The aim is to identify and maintain infeasible solutions close to the feasible region located in promising areas. In this way, using the genetic operators, more solutions will be generated inside the feasible region and also near its boundaries. As a result, the feasible region will be sampled well-enough as to reach better feasible solutions. The proposed approach, which is simple to implement, is tested with respect to typical penalty function techniques as well as against state-of-the-art approaches using four mechanical design problems. The results obtained are discussed and some conclusions are provided.
TL;DR: An evolutionary algorithm with guided mutation (EA/G) for the maximum clique problem is proposed in this paper and experimental results show that EA/G outperforms the heuristic genetic algorithm of Marchiori and a MIMIC algorithm on DIMACS benchmark graphs.
Abstract: Estimation of distribution algorithms sample new solutions (offspring) from a probability model which characterizes the distribution of promising solutions in the search space at each generation. The location information of solutions found so far (i.e., the actual positions of these solutions in the search space) is not directly used for generating offspring in most existing estimation of distribution algorithms. This paper introduces a new operator, called guided mutation. Guided mutation generates offspring through combination of global statistical information and the location information of solutions found so far. An evolutionary algorithm with guided mutation (EA/G) for the maximum clique problem is proposed in this paper. Besides guided mutation, EA/G adopts a strategy for searching different search areas in different search phases. Marchiori's heuristic is applied to each new solution to produce a maximal clique in EA/G. Experimental results show that EA/G outperforms the heuristic genetic algorithm of Marchiori (the best evolutionary algorithm reported so far) and a MIMIC algorithm on DIMACS benchmark graphs.
TL;DR: This paper tests the merit of several scatter search designs in the context of global optimization of multimodal functions and chooses one to compare against a well-known genetic algorithm that has been specifically developed for this class of problems.
Abstract: Scatter search is an evolutionary method that, unlike genetic algorithms, operates on a small set of solutions and makes only limited use of randomization as a proxy for diversification when searching for a globally optimal solution. The scatter search framework is flexible, allowing the development of alternative implementations with varying degrees of sophistication. In this paper, we test the merit of several scatter search designs in the context of global optimization of multimodal functions. We compare these designs among themselves and choose one to compare against a well-known genetic algorithm that has been specifically developed for this class of problems. The testing is performed on a set of benchmark multimodal functions with known global minima.
TL;DR: A crossover operator for evolutionary algorithms with real values that is based on the statistical theory of population distributions that takes into account the localization and dispersion features of the best individuals of the population with the objective that these features would be inherited by the offspring.
Abstract: In this paper we propose a crossover operator for evolutionary algorithms with real values that is based on the statistical theory of population distributions The operator is based on the theoretical distribution of the values of the genes of the best individuals in the population The proposed operator takes into account the localization and dispersion features of the best individuals of the population with the objective that these features would be inherited by the offspring Our aim is the optimization of the balance between exploration and exploitation in the search process
In order to test the efficiency and robustness of this crossover, we have used a set of functions to be optimized with regard to different criteria, such as, multimodality, separability, regularity and epistasis With this set of functions we can extract conclusions in function of the problem at hand We analyze the results using ANOVA and multiple comparison statistical tests
As an example of how our crossover can be used to solve artificial intelligence problems, we have applied the proposed model to the problem of obtaining the weight of each network in a ensemble of neural networks The results obtained are above the performance of standard methods
TL;DR: The experimental results show that the evolutionary sequence design by NACST/Seq outperforms in its reliability the existing sequence design techniques such as conventional EAs, simulated annealing, and specialized heuristic methods.
Abstract: DNA computing relies on biochemical reactions of DNA molecules and may result in incorrect or undesirable computations. Therefore, much work has focused on designing the DNA sequences to make the molecular computation more reliable. Sequence design involves with a number of heterogeneous and conflicting design criteria and traditional optimization methods may face difficulties. In this paper, we formulate the DNA sequence design as a multiobjective optimization problem and solve it using a constrained multiobjective evolutionary algorithm (EA). The method is implemented into the DNA sequence design system, NACST/Seq, with a suite of sequence-analysis tools to help choose the best solutions among many alternatives. The performance of NACST/Seq is compared with other sequence design methods, and analyzed on a traveling salesman problem solved by bio-lab experiments. Our experimental results show that the evolutionary sequence design by NACST/Seq outperforms in its reliability the existing sequence design techniques such as conventional EAs, simulated annealing, and specialized heuristic methods.