1 / 14

Self-organizing Maps

Self-organizing Maps. Kevin Pang. Goal. Research SOMs Create an introductory tutorial on the algorithm Advantages / disadvantages Current applications Demo program. Self-organizing Maps. Unsupervised learning neural network Maps multidimensional data onto a 2 dimensional grid

gordon
Télécharger la présentation

Self-organizing Maps

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Self-organizing Maps Kevin Pang

  2. Goal • Research SOMs • Create an introductory tutorial on the algorithm • Advantages / disadvantages • Current applications • Demo program

  3. Self-organizing Maps • Unsupervised learning neural network • Maps multidimensional data onto a 2 dimensional grid • Geometric relationships between image points indicate similarity

  4. Algorithm • Neurons arranged in a 2 dimensional grid • Each neuron contains a weight vector • Example: RGB values

  5. Algorithm (continued…) • Initialize weights • Random • Pregenerated • Iterate through inputs • For each input, find the “winning” neuron • Euclidean distance • Adjust “winning” neuron and its neighbors • Gaussian • Mexican hat

  6. Optimization Techniques • Reducing input / neuron dimensionality • Random Projection method • Pregenerating neuron weights • Initialize map closer to final state • Restricting “winning” neuron search • Reduce the amount of exhaustive searches

  7. Conclusions • Advantages • Data mapping is easily interpreted • Capable of organizing large, complex data sets • Disadvantages • Difficult to determine what input weights to use • Mapping can result in divided clusters • Requires that nearby points behave similarly

  8. Current Applications • WEBSOM: Organization of a Massive Document Collection

  9. Current Applications (continued) • Phonetic Typewriter

  10. Current Applications (continued) • Classifying World Poverty

  11. Demo Program • Written for Windows with GLUT support • Demonstrates the SOM training algorithm in action

  12. Demo Program Details • Randomly initialized map • 100 x 100 grid of neurons, each containing a 3-dimensional weight vector representing its RGB value • Training input randomly selected from 48 unique colors • Gaussian neighborhood function

  13. Screenshots

  14. Questions?

More Related