loading...
Visualizing Attribute Interdependencies Using Mutual Information, Hierarchical Clustering, Multidimensional Scaling, and Self-organizing Maps
Big Island, Hawaii January 03-January 06
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/HICSS.2007.60840th Annual Hawaii International Conf ...
 This Article 
 
PURCHASE ARTICLE: $0
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Derek L. Nazareth, University of Wisconsin-Milwaukee
Ehsan S. Soofi, University of Wisconsin-Milwaukee
Huimin Zhao, University of Wisconsin-Milwaukee
Data pre-processing tends to be the most critical and time-consuming step during data mining processes. Understanding the interdependencies among the attributes is especially important for attribute selection and model structure design. Correlation measures, such as Pearson correlation coefficient, have been typically used to measure attribute dependencies. Correlation is useful for capturing linear dependency among quantitative attributes, and is invariant under linear transformations of the variables only. More recently, mutual information has been used to measure interdependencies among attributes measured in continuous scale. Mutual information is applicable to quantitative and categorical variables, captures any type of functional dependency between variables, and is invariant under one-to-one transformations. In this paper, we employ mutual information as a unified measure of interdependencies among attributes, by extending it to accommodate attributes measured in continuous and categorical scales. We further visualize the attribute interdependencies using a host of techniques, including hierarchical clustering, multidimensional scaling, and self-organizing maps. The use of mutual information permits identification of some salient interdependencies between attributes. We demonstrate the utility of the proposed methodology using real data mining applications.
Citation:
Derek L. Nazareth, Ehsan S. Soofi, Huimin Zhao, "Visualizing Attribute Interdependencies Using Mutual Information, Hierarchical Clustering, Multidimensional Scaling, and Self-organizing Maps," hicss, pp.53c, 40th Annual Hawaii International Conference on System Sciences (HICSS'07), 2007
Usage of this product signifies your acceptance of the Terms of Use.