Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture

Saurabh Karsoliya

doi:https://doi.org/10.14445/22315381/IJETT-V3I6P206

Research Article | Open Access | Download PDF

Volume 3 | Issue 6 | Year 2012 | Article Id. IJETT-V3I6P206 | DOI : https://doi.org/10.14445/22315381/IJETT-V3I6P206

Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture

Saurabh Karsoliya

Citation :

Saurabh Karsoliya, "Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture," International Journal of Engineering Trends and Technology (IJETT), vol. 3, no. 6, pp. 714-717, 2012. Crossref, https://doi.org/10.14445/22315381/IJETT-V3I6P206

Abstract

Hidden layers plays a vital role in the performance of Back Propagation Neural Network especially in the case where problems related to arbitrary decision boundary to arbitrary accuracy with rational activation functions are encountered. Also, multiple hidden layer can approximate any smooth mapping to any accuracy . The process of deciding the number of hidden layers and number of neurons in each hidden layer is still confusing. In this paper , an survey is made in order to resolved the problem of number of neurons in each hidden layer and the number of hidden layers required

Keywords

Neural Network , BPNN, Hidden Layer, Neurons,

References

[1] Boger, Z., and Guterman, H., 1997, "Knowledge extraction from artificial neural network models," IEEE Systems, Man, and Cybernetics Conference , Orlando, FL, USA
[2] Berry, M.J.A., and Linoff, G. 1997, Data Mining Techniques , NY: John Wiley & Sons
[3] Kazuhiro Shin - ike , “ A Two Phase Method for Determining the Number of Neurons in the Hidden Layer of a 3 - Layer Neural Network ” , SICE Annual Conference 2010, August 18 - 21, 20 1 0, The Grand Hotel, Taipei, Taiwan.
[4] http://www.heatonresearch.com/node/707
[5] Stuti Asthana and Rakesh K Bhujade , “ Handwritten Multiscript Pin Code Recognition System having Multiple hidden layers using Back Propagation Neural Network ” , International Journal of Electronics Communication and Computer Engineering, ISSN(Online): 2249 - 071X, Volume 2, Issue 1, Sep 2011
[6] Blum, A., 1992, Neural Networks in C++, NY: Wiley.
[7] Rivals I. & Personnaz L. “A statistical procedure for determining the optimal number of hidden neurons of a neuralmodel”, Second International Symposium on Neural Computation (NC’200 0), Berlin, May 23 - 26 2000.
[8] Fnaiech, F., Fnaiech, N., Najim, M., 2001 “A new feedforward neural network hidden layer neuron pruning algorithm ”IEEE International Conference on Acoustics, Speech, and Signal Processing, 2001. Proceedings. (ICASSP `01).
[9] Y inyin Liu, Janusz A. Starzyk, Zhen Zhu, “Optimizing Number Of Hidden Neurons in Neural Networks”, http://www.ohio.edu/people/starzykj/network/Research/Papers/ Recent%20conferences../Hidden%20Neurons%20AIA2007_549 - 204.pdf
[10] Jacques de Villiers and Etienne Barn ard, 1992, “ Backpropagation Neural Nets with One and Two Hidden Layers ”, IEEE Transactions o n Neural Networks, Vol. 4, No. 1