Using self-organizing maps for regression: the importance of the output function

Thomas Hecht (1) , Mathieu Lefort (2, 1) , Alexander Gepperth (2, 1)

1 RV - Robotique et Vision
2 Flowers - Flowing Epigenetic Robots and Systems

Self-organizing map (SOM) is a powerful paradigm that is extensively applied for clustering and visualization purpose. It is also used for regression learning, especially in robotics, thanks to its ability to provide a topological projection of high dimensional non linear data. In this case, data extracted from the SOM are usually restricted to the best matching unit (BMU), which is the usual way to use SOM for classification , where class labels are attached to individual neurons. In this article, we investigate the influence of considering more information from the SOM than just the BMU when performing regression. For this purpose , we quantitatively study several output functions for the SOM, when using these data as input of a linear regression, and find that the use of additional activities to the BMU can strongly improve regression performance. Thus, we propose an unified and generic framework that embraces a large spectrum of models from the traditional way to use SOM, with the best matching unit as output, to models related to the radial basis function network paradigm, when using local receptive field as output.

Domaines: Apprentissage [cs.LG]

Thomas Hecht, Mathieu Lefort, Alexander Gepperth. Using self-organizing maps for regression: the importance of the output function. European Symposium on Artificial Neural Networks (ESANN), Apr 2015, Bruges, Belgium. ⟨hal-01251011⟩