This paper introduces a new learning algorithm for multi-layered feedforward network 3/4 weight evolution algorithm with deterministic perturbation. During the learning phase of the gradient algorithm (such as back-propagation), the network weights are adjusted intentionally in order to have an improvement in system performance. The intention is to reduce the overall system error after every weight update. By looking at the error component, it is possible to adjust some of the network weights deterministically to have an overall reduction in system error. Using the deterministic perturbation, it is found that the weight evolution between the hidden and output layer can accelerate the convergence speed, whereas the weight evolution between the input layer and the hidden layer can assist in solving the local minima problem.
Citation:
Sin-Chun Ng, Shu-Hung Leung, Andrew Luk, "A Weight Evolution Algorithm with Deterministic Perturbation," ijcnn, vol. 1, pp.1185, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1, 2000