Evolutionary Neural Network Learning
Miguel Rocha,Paulo Cortez,José Neves +2 more
- 04 Dec 2003
- Vol. 2902, pp 24-28
40
TL;DR: In this work, EAs using direct representations are applied to several classification and regressionANN learning tasks and are also combined with local optimization, under the Lamarckian framework, to reveal an enhanced performance by a macro-mutation based Lamarckerian approach.
read more
Abstract: Several gradient-based methods have been developed for Artificial Neural Network (ANN) training. Still, in some situations, such procedures may lead to local minima, making Evolutionary Algorithms (EAs) a promising alternative. In this work, EAs using direct representations are applied to several classification and regressionANN learning tasks. Furthermore, EAs are also combined with local optimization, under the Lamarckian framework. Both strategies are compared with conventional training methods. The results reveal an enhanced performance by a macro-mutation based Lamarckian approach.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
neuralnet: Training of Neural Networks
Frauke Günther,Stefan Fritsch +1 more
TL;DR: The paper gives a brief introduction to multi- layer perceptrons and resilient backpropagation and demonstrates the application of neuralnet using the data set infert, which is contained in the R distribution.
Evolution of neural networks for classification and regression
TL;DR: This work presents two hybrid EC/ANN algorithms: the first evolves neural topologies while the latter performs simultaneous optimization of architectures and weights.
125
A Geometrical Method to Improve Performance of the Support Vector Machine
TL;DR: This letter investigates a geometrical method to optimize the kernel function, a modification of the one proposed by S. Amari and S. Wu, that works efficiently and overcomes the susceptibility of the original method.
46
Evolution of Plastic Learning in Spiking Networks via Memristive Connections
TL;DR: In this paper, a spiking neuroevolutionary system which implements memristors as plastic connections is presented, i.e. whose weights can vary during a trial, allowing the evolution of networks of appropriate complexity to emerge whilst exploiting the memristive properties of the connections to reduce learning time.
44
References
•Book
Neural networks for pattern recognition
Christopher M. Bishop
- 01 Jan 1995
TL;DR: This is the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition, and is designed as a text, with over 100 exercises, to benefit anyone involved in the fields of neural computation and pattern recognition.
•Book
Genetic Algorithms + Data Structures = Evolution Programs
Zbigniew Michalewicz
- 01 Jan 1992
TL;DR: GAs and Evolution Programs for Various Discrete Problems, a Hierarchy of Evolution Programs and Heuristics, and Conclusions.
13.5K
Neural Networks for Pattern Recognition
Christopher M. Bishop
- 23 Nov 1995
Abstract: Abstract This book provides the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition. After introducing the basic concepts of pattern recognition, the book describes techniques for modelling probability density functions, and discusses the properties and relative merits of the multi-layer perceptron and radial basis function network models. It also motivates the use of various forms of error functions, and reviews the principal algorithms for error function minimization. As well as providing a detailed discussion of learning and generalization in neural networks, the book also covers the important topics of data processing, feature extraction, and prior knowledge. The book concludes with an extensive treatment of Bayesian techniques and their applications to neural networks.
9.8K
Evolving artificial neural networks
Xin Yao
- 01 Sep 1999
TL;DR: It is shown, through a considerably large literature review, that combinations between ANNs and EAs can lead to significantly better intelligent systems than relying on ANNs or EAs alone.