Mini-max initialization for function approximation

Xi Min Zhang, Yan Qiu Chen, Nirwan Ansari, Yun Q. Shi

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

Neural networks have been successfully applied to various pattern recognition and function approximation problems. However, the training process remains a time-consuming procedure that often gets stuck in a local minimum. The optimum network size and topology are usually unknown. In this paper, we formulate the concept of extrema equivalence for estimating the complexity of a function. Based on this formulation, the optimal network size and topology can be selected according to the number of extrema. Mini-max initialization method is then proposed to select the initial values of the weights for the network that is proven to greatly speed up training. The superior performance of our method in terms of convergence and generalization has been substantiated by experimental results.

Original languageEnglish (US)
Pages (from-to)389-409
Number of pages21
JournalNeurocomputing
Volume57
Issue number1-4
DOIs
StatePublished - Mar 2004

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Cognitive Neuroscience
  • Computer Science Applications

Keywords

  • Chessboard initialization
  • Extrema equivalence
  • Mini-max initialization
  • Promising area
  • Random initialization

Fingerprint

Dive into the research topics of 'Mini-max initialization for function approximation'. Together they form a unique fingerprint.

Cite this