An enhanced training algorithm for multilayer neural networks based on reference output of hidden layer
Article
Article Title | An enhanced training algorithm for multilayer neural networks based on reference output of hidden layer |
---|---|
ERA Journal ID | 18089 |
Article Category | Article |
Authors | Li, Yan (Author), Rad, A. B. (Author) and Wen, Peng (Author) |
Journal Title | Neural Computing and Applications |
Journal Citation | 8, pp. 218-225 |
Number of Pages | 8 |
Year | 1999 |
Publisher | Springer |
Place of Publication | London UK |
ISSN | 0941-0643 |
1433-3058 | |
Abstract | In this paper, the authors propose a new training algorithm which does not only rely upon the training samples, but also depends upon the output of the hidden layer. We adjust both the connecting weights and outputs of the hidden layer based on Least Square Backpropagation (LSB) algorithm. A set of ‘required’ outputs of the hidden layer is added to the input sets through a feedback path to accelerate the convergence speed. The numerical simulation results have demonstrated that the algorithm is better than conventional BP, Quasi-Newton BFGS (an alternative to the conjugate gradient methods for fast optimisation) and LSB algorithms in terms of convergence speed and training error. The proposed method does not suffer from the drawback of the LSB algorithm, for which the training error cannot be further reduced after three iterations. |
Keywords | backpropagation, BFGS quasi-Newton, conjugate gradient algorithm, least square, multilayer neural networks |
ANZSRC Field of Research 2020 | 469999. Other information and computing sciences not elsewhere classified |
Byline Affiliations | Hong Kong Polytechnic University, China |
Flinders University | |
Institution of Origin | University of Southern Queensland |
https://research.usq.edu.au/item/q25w6/an-enhanced-training-algorithm-for-multilayer-neural-networks-based-on-reference-output-of-hidden-layer
Download files
1756
total views188
total downloads7
views this month0
downloads this month