deposit_your_work

Learning the Structure of High-Dimensional Manifolds with Self-Organizing Maps for Accurate Information Extraction

Files in this item

Files Size Format View
PhD_thesis_Lili ... 062011_signedtitlepage.pdf 5.786Mb application/pdf Thumbnail

Show full item record

Item Metadata

Title: Learning the Structure of High-Dimensional Manifolds with Self-Organizing Maps for Accurate Information Extraction
Author: Zhang, Lili
Advisor: Erzsébet Merényi
Degree: Doctor of Philosophy thesis
Abstract: This work aims to improve the capability of accurate information extraction from high-dimensional data, with a specific neural learning paradigm, the Self-Organizing Map (SOM). The SOM is an unsupervised learning algorithm that can faithfully sense the manifold structure and support supervised learning of relevant information from the data. Yet open problems regarding SOM learning exist. We focus on the following two issues. 1. Evaluation of topology preservation. Topology preservation is essential for SOMs in faithful representation of manifold structure. However, in reality, topology violations are not unusual, especially when the data have complicated structure. Measures capable of accurately quantifying and informatively expressing topology violations are lacking. One contribution of this work is a new measure, the Weighted Differential Topographic Function (WDTF), which differentiates an existing measure, the Topographic Function (TF), and incorporates detailed data distribution as an importance weighting of violations to distinguish severe violations from insignificant ones. Another contribution is an interactive visual tool, TopoView, which facilitates the visual inspection of violations on the SOM lattice. We show the effectiveness of the combined use of the WDTF and TopoView through a simple two-dimensional data set and two hyperspectral images. 2. Learning multiple latent variables from high-dimensional data. We use an existing two-layer SOM-hybrid supervised architecture, which captures the manifold structure in its SOM hidden layer, and then, uses its output layer to perform the supervised learning of latent variables. In the customary way, the output layer only uses the strongest output of the SOM neurons. This severely limits the learning capability. We allow multiple, k, strongest responses of the SOM neurons for the supervised learning. Moreover, the fact that different latent variables can be best learned with different values of k motivates a new neural architecture, the Conjoined Twins, which extends the existing architecture with additional copies of the output layer, for preferential use of different values of k in the learning of different latent variables. We also automate the customization of k for different variables with the statistics derived from the SOM. The Conjoined Twins shows its effectiveness in the inference of two physical parameters from Near-Infrared spectra of planetary ices.
Citation: Zhang, Lili. (2011) "Learning the Structure of High-Dimensional Manifolds with Self-Organizing Maps for Accurate Information Extraction." Doctoral Thesis, Rice University. http://hdl.handle.net/1911/62283.
URI: http://hdl.handle.net/1911/62283
Date: 2011

The following license files are associated with this item:

This item appears in the following Collection(s)