140 likes | 286 Vues
The Evolving Tree — Analysis and Applications. Advisor : Dr. Hsu Presenter : Zih-Hui Lin Author :Jussi Pakkanen, Jukka Iivarinen, and Erkki Oja,. IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 17, NO. 3, MAY 2006. Outline. Motivation Objective ETree ETree- Analysis Experiments
E N D
The Evolving Tree—Analysis and Applications Advisor : Dr. Hsu Presenter : Zih-Hui Lin Author :Jussi Pakkanen, Jukka Iivarinen, and Erkki Oja, IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 17, NO. 3, MAY 2006
Outline • Motivation • Objective • ETree • ETree-Analysis • Experiments • Conclusions
Motivation • Some of its intrinsic features make it unsuitable for analyzing very large scale problems. • This converts complexity control from a global problem to a local one which is simpler.
Objective • We have analyzed and compared the ETree against many different systems.
hop BMU ETree Xi Training data 1)Find the BMU using the search tree 2) Update the leaf node locations using the SOM training formulas substituting tree distance for grid distance. 3) Increment the BMU’s hit counter. 4) If the counter reaches the splitting threshold, split the node.
ETree-Removing Layers • One beneficial feature of most neural networks is graceful degradation.
ETree- better Search for the BMU • At every layer we keep the n best subbranches instead of only one. Regular BMU 51 52 55
ETree- Child Node Initialization • The first perturbs the child nodes randomly. • The second one is based on principal component analysis (PCA).
ETree- Optimizing the Leaf Node Locations 1)First, we map all training vectors to leaf nodes using the established BMU search. 2)Then we move the leaf nodes to the center of mass of their respective data vectors. Large dataset
Visualization experiments data vector ETree Leaf nodes SOM K-means
Quality of clustering without the search tree
Conclusions • ETree’s performance is quite close to classical, nonhierarchical algorithms but it is noticeably faster, • ETree makes implementation and application easier.
My opinion • Advantage: • … • Disadvantage: • … • Apply • clustering, classification, large dataset