Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection

•HPSO-SSM is proposed based on original particle swarm optimization.•A new wrapper-based feature selection approach based on HPSO-SSM is proposed.•The logistic map sequence is used to enhance the diversity in the search process.•An innovative position update model is presented to improve the positio...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Expert systems with applications 2019-08, Vol.128, p.140-156
Hauptverfasser: Chen, Ke, Zhou, Feng-Yu, Yuan, Xian-Feng
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•HPSO-SSM is proposed based on original particle swarm optimization.•A new wrapper-based feature selection approach based on HPSO-SSM is proposed.•The logistic map sequence is used to enhance the diversity in the search process.•An innovative position update model is presented to improve the position quality.•Our method outperforms seventeen extremely competitive methods in terms of accuracy. The “curse of dimensionality” is one of the largest problems that influences the quality of the optimization process in most data mining, pattern recognition, and machine learning tasks. Using high-dimensional datasets to train a classification model may reduce the generalization performance of the learned model. In addition, high dimensionality of the dataset results in high computational and memory costs. Feature selection is an important data preprocessing approach in many practical application domains that are relevant to expert and intelligent systems. Feature selection aims at selecting a subset of informative and relevant features from an original feature dataset. Therefore, using a feature selection approach to process the original data prior to the learning process is essential for enhancing the performance on the classification task. In this paper, hybrid particle swarm optimization with a spiral-shaped mechanism (HPSO-SSM) is proposed for selecting the optimal feature subset for classification via a wrapper-based approach. In HPSO-SSM, we make three improvements: First, a logistic map sequence is used to enhance the diversity in the search process. Second, two new parameters are introduced into the original position update formula, which can effectively improve the position quality of the next generation. Finally, a spiral-shaped mechanism is adopted as a local search operator around the known optimal solution region. For a complete evaluation, the proposed HPSO-SSM method is compared with six state-of-the-art meta-heuristic optimization algorithms, ten well-known wrapper-based feature selection techniques, and six classic filter-based feature selection methods. Various assessment indicators are used to properly evaluate and compare the performances of these approaches on twenty classic benchmark classification datasets from the UCI machine learning repository. According to the experimental results and statistical tests, the developed methods effectively and efficiently improve the classification accuracy compared with other wrapper-based approaches and fil
ISSN:0957-4174
1873-6793
DOI:10.1016/j.eswa.2019.03.039