Open AccessPosted Content
An optimized recursive learning algorithm for three-layer feedforward neural networks for mimo nonlinear system identifications
Daohang Sha,Vladimir B. Bajic +1 more
TL;DR: In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method.
read more
Abstract: Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method. The proof of weak convergence of the proposed algorithm also is given. Although this approach is proposed for three-layer, feed-forward neural networks, it could be extended to multiple layer feed-forward neural networks. The effectiveness of the proposed algorithms applied to the identification of behavior of a two-input and two-output non-linear dynamic system is demonstrated by simulation experiments.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
References
•Book
Learning internal representations by error propagation
David E. Rumelhart,Geoffrey E. Hinton,Ronald J. Williams +2 more
- 03 Jan 1986
TL;DR: In this paper, the problem of the generalized delta rule is discussed and the Generalized Delta Rule is applied to the simulation results of simulation results in terms of the generalized delta rule.
16K
Identification and control of dynamical systems using neural networks
TL;DR: It is demonstrated that neural networks can be used effectively for the identification and control of nonlinear dynamical systems and the models introduced are practically feasible.
8.1K
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Bernard Widrow,Michael A. Lehr +1 more
- 01 Sep 1990
TL;DR: The history, origination, operating characteristics, and basic theory of several supervised neural-network training algorithms (including the perceptron rule, the least-mean-square algorithm, three Madaline rules, and the backpropagation technique) are described.
A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction
C.L.P. Chen,J.Z. Wan +1 more
- 01 Feb 1999
TL;DR: A fast learning algorithm is proposed to find an optimal weights of the flat neural networks (especially, the functional-link network) using a linear least-square method and indicates that the proposed model is very attractive to real-time processes.
250
Fast training algorithms for multilayer neural nets
TL;DR: An algorithm that is faster than back-propagation and for which it is not necessary to specify the number of hidden units in advance is described, and accuracy is comparable to that for the nearest-neighbor algorithm, which is slower and requires more storage space.