Auto-SOM: Recursive parameter estimation for guidance of self-organizing feature maps

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

An important technique for exploratory data analysis is to form a mapping from the high-dimensional data space to a low-dimensional representation space such that neighborhoods are preserved. A popular method for achieving this is Kohonen's self-organizing map (SOM) algorithm. However, in its original form, this requires the user to choose the values of several parameters heuristically to achieve good performance. Here we present the Auto-SOM, an algorithm that estimates the learning parameters during the training of SOMs automatically. The application of Auto-SOM provides the facility to avoid neighborhood violations up to a user-defined degree in either mapping direction. Auto-SOM consists of a Kalman filter implementation of the SOM coupled with a recursive parameter estimation method. The Kalman filter trains the neurons' weights with estimated learning coefficients so as to minimize the variance of the estimation error. The recursive parameter estimation method estimates the width of the neighborhood function by minimizing the prediction error variance of the Kalman filter. In addition, the "topographic function" is incorporated to measure neighbor-hood violations and prevent the map's converging to configurations with neighborhood violations. It is demonstrated that neighborhoods can be preserved in both mapping directions as desired for dimension-reducing applications. The development of neighborhood-preserving maps and their convergence behavior is demonstrated by three examples accounting for the basic applications of self-organizing feature maps.

Original languageEnglish
Pages (from-to)595-619
Number of pages25
JournalNeural Computation
Volume13
Issue number3
DOIs
StatePublished - Mar 2001

Fingerprint

Dive into the research topics of 'Auto-SOM: Recursive parameter estimation for guidance of self-organizing feature maps'. Together they form a unique fingerprint.

Cite this