大规模前馈神经网络的一种有效学习算法及其应用

AN EFFICIENT LEARNING ALGORITHM FOR LARGE-SCALE FEEDFORWARD NEURAL NETWORKS AND ITS APPLICATION

  • 摘要: 前馈神经网络在复杂系统建模中局限于小型或中等规模的系统,主要原因是:对于大规模问题,现有的神经网络学习算法或者收敛太慢,或者难以收敛.针对这一问题,本文提出一种基于改进的拟牛顿方法的神经网络学习算法该算法内存需要量小,收敛速度快,适合高维神经网络的训练.本文利用该算法训练神经网络建立32输入工业产品质量模型,结果表明了该算法的有效性.

     

    Abstract: Feedforward neural networks are used for modeling the behavior of complex systems. However, most of the published papers dealt with small-or medium-scale systems. One of the possible reasons is that it is too slow or impossible for the learning algorithims of large-scale neural networks to converge. In this paper, a neural network algorithm based on modified quasi-Newton method is introduced, aiming at enhancing the neural network's ability to solve the modeling problem of large scale systems. Compared with quasi Newton method, this algorithm needs less memory and the convergence speed is almost the same. The proposed methodology is applied to modeling of industrial product quality with 32-input. Simulation results show the effectiveness of the approach.

     

/

返回文章
返回