Reducing performance bias for unbalanced text mining
Zhuang, Ling and Dai, Honghua 2006, Reducing performance bias for unbalanced text mining, in ICDM Workshops 2006 proceedings : 18 December, 2006, Hong Kong, China, IEEE Computer Society, Los Alamitos, Calif., pp. 770-774.
ICDM Workshops 2006 proceedings : 18 December, 2006, Hong Kong, China
Tsumoto, Shusaku Clifton, Christopher W. Zhong, Ning Wu, Xindong Liu, Jiming Wah, Benjamin W. Cheung, Yiu-Ming
IEEE International Conference on Data Mining Workshops
IEEE Computer Society
Place of publication
Los Alamitos, Calif.
In text categorization applications, class imbalance, which refers to an uneven data distribution where one class is represented by far more less instances than the others, is a commonly encountered problem. In such a situation, conventional classifiers tend to have a strong performance bias, which results in high accuracy rate on the majority class but very low rate on the minorities. An extreme strategy for unbalanced, learning is to discard the majority instances and apply one-class classification to the minority class. However, this could easily cause another type of bias, which increases the accuracy rate on minorities by sacrificing the majorities. This paper aims to investigate approaches that reduce these two types of performance bias and improve the reliability of discovered classification rules. Experimental results show that the inexact field learning method and parameter optimized one-class classifiers achieve more balanced performance than the standard approaches.