loading...
On the Combination of Weight-Decay and Input Selection Methods
Como, Italy July 24-July 27
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IJCNN.2000.857835IEEE-INNS-ENNS International Joint Co ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mercedes Fernández-Redondo, Universidad Jaume I
Carlos Hernández-Espinosa, Universidad Jaume I
In this paper, we present the results of a research on the combination of weight-decay and input selection methods based on the analysis of a trained multilayer feedforward network. This combination was proposed and suggested by some authors. The influence of weight-decay in seventeen different input selection methods is empirically analyzed with eight classification problems. We show that the performance variation by introducing weight-decay strongly depends on the particular input selection method. The use of weight-decay can even deteriorate the efficiency of a method. Furthermore, it seems that weight-decay improves the performance of the worst input selection methods and deteriorate the performance of the best ones. In that sense, it diminishes the performance differences among different methods. We think that the combination of weight-decay and this type of input selection methods should be avoided.
Citation:
Mercedes Fernández-Redondo, Carlos Hernández-Espinosa, "On the Combination of Weight-Decay and Input Selection Methods," ijcnn, vol. 1, pp.1191, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1, 2000
Usage of this product signifies your acceptance of the Terms of Use.