QUASI NEWTON ALGORITHM OF ADAPTIVE DECOUPLED STEP AND MOMENTUM FOR NEURAL NETWORK

In this paper, a quasi Newton algorithm with adaptive decoupled step and momentum(QNADSM) used in three layered feedforward neural network is derived from adaptive BP algorithm and Newton algorithm, which is of less computational amount and fast convergence. In this note we also present the proof of the convergence and simulation results. The simulation results demonstrate that QNADSM algorithm is an effectively practical algorithm.