A novel probabilistic feature selection method for text classification


UYSAL A. K., GÜNAL S.

KNOWLEDGE-BASED SYSTEMS, cilt.36, ss.226-235, 2012 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 36
  • Basım Tarihi: 2012
  • Doi Numarası: 10.1016/j.knosys.2012.06.005
  • Dergi Adı: KNOWLEDGE-BASED SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.226-235
  • Anahtar Kelimeler: Feature selection, Filter, Pattern recognition, Text classification, Dimension reduction, INFORMATION GAIN, ALGORITHM, SYSTEM
  • Anadolu Üniversitesi Adresli: Evet

Özet

High dimensionality of the feature space is one of the most important concerns in text classification problems due to processing time and accuracy considerations. Selection of distinctive features is therefore essential for text classification. This study proposes a novel filter based probabilistic feature selection method, namely distinguishing feature selector (DFS), for text classification. The proposed method is compared with well-known filter approaches including chi square, information gain, Gini index and deviation from Poisson distribution. The comparison is carried out for different datasets, classification algorithms, and success measures. Experimental results explicitly indicate that DFS offers a competitive performance with respect to the abovementioned approaches in terms of classification accuracy, dimension reduction rate and processing time. (C) 2012 Elsevier B.V. All rights reserved.