Open Access Open Access  Restricted Access Subscription Access

Feature Selection Using Nature-Inspired Metaheuristics: A Brief Study

Siddharth Kothari, Sharma Chetan, Ritik Sharma, Sanskar Sharma, Divya Jain

Abstract


In recent decades, feature selection (FS) has attracted a lot of attention. The rapid advancement of data and computer science has led to an increase in the number of studies being conducted. The preprocessing method of feature selection plays a significant role in increasing the effectiveness of data mining and analysis across significant real-world applications. To summarize the most recent studies, this research work offers a quick assessment on feature selection for classification in this decade, based on accuracy, stability, scalability, and processing cost are the primary difficulties facing researchers.


Keywords


Metaheuristics, PSO, ant lion optimizer, grasshopper optimization algorithm, feature selection

Full Text:

PDF

References


Dash M, Liu H. Feature selection for classification. Intell Data Anal. 1997; 1(1–4): 131–156.

Li J, Cheng K, Wang S, Morstatter F, Trevino RP, Tang J, Liu H. Feature selection: A data perspective. ACM Comput Surv. 2018; 50(6): 94.1–94.45.

Dheeru D, Karra Taniskidou E. (2017). UCI machine learning repository. [Online]. Available: http://archive.ics.uci.edu/ml

Guyon I, Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res. 2003; 3(6): 1157–1182.

Xue B, Zhang M, Browne WN, Yao X. A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput. 2016; 20(4): 606–626.

Hichem H, Rafik M, Messaoud MT. PSO with crossover operator applied to feature selection problem in classification. Informatica (Slovenia). 2018; 42(2): 189–198.

Qiu C. Bare bones particle swarm optimization with adaptive chaotic jump for feature selection in classification. Int J Comput Intell Syst. 2018; 11(1): 1–14.

Sakri SB, Rashid NBA, Zain ZM. Particle swarm optimization feature selection for breast cancer recurrence prediction. IEEE Access. 2018; 6: 29637–29647.

Xue B, Zhang M, Browne WN. Multi-objective particle swarm optimisation (PSO) for feature selection. In Genetic and Evolutionary Computation Conference, GECCO ’12, Philadelphia, PA, USA. 2012 Jul 7–11; 81–88. 10. Xue B, Zhang M, Browne WN. Particle swarm optimization for feature selection in classification: A multi-objective approach. IEEE Trans Cybern. 2013; 43(6): 1656–1671.

Wan Y, Wang M, Ye Z, Lai X. A feature selection method based on modified binary coded ant colony optimization algorithm. Appl Soft Comput. 2016; 49: 248–258.

Peng H, Ying C, Tan S, Hu B, Sun Z. An improved feature selection algorithm based on ant colony optimization. IEEE Access. 2018; 6: 69203–69209.

Sharawi M, Zawbaa HM, Emary E. Feature selection approach based on whale optimization algorithm. In 9th International Conference on Advanced Computational Intelligence, ICACI 2017, Doha, Qatar. 2017 Feb 4–6; 163–168.

Sayed GI, Darwish A, Hassanien AE. A new chaotic whale optimization algorithm for features selection. J Classif. 2018; 35(2): 300–344.

Emary E, Zawbaa HM, Hassanien AE. Binary ant lion approaches for feature selection. Neurocomputing. 2016; 213: 54–65.

Zawbaa HM, Emary E, Grosan C. Feature selection via chaotic antlion optimization. Plos One. 2016; 11(3): e0150652.

Mafarja MM, Eleyan D, Abdullah S, Mirjalili S. S-shaped vs. v-shaped transfer functions for ant lion optimization algorithm in feature selection problem. In Proceedings of the International Conference on Future Networks and Distributed Systems, ICFNDS 2017, Cambridge, United Kingdom. 2017 Jul 19–20; 21(7p).

Ozger ZB, Bolat B, Diri B. A comparative study on binary artificial bee colony optimization methods for feature selection. In International Symposium on Innovations in Intelligent Systems and Applications, INISTA 2016, Sinaia, Romania. 2016 Aug 2–5; 1–4.

Hancer E, Xue B, Zhang M, Karaboga D, Akay B. Pareto front feature selection based on artificial bee colony optimization. Inf Sci. 2018; 422: 462–479.

Kuo R, Huang SBL, Zulvia FE, Liao TW. Artificial bee colony-based support vector machines with feature selection and parameter optimization for rule extraction. Knowl Inf Syst. 2018; 55(1): 253–274.

Arora S, Anand P. Binary butterfly optimization approaches for feature selection. Expert Syst Appl. 2019; 116: 147–160.

Gunavathi C, Premalatha K. Cuckoo search optimisation for feature selection in cancer classification: a new approach. Int J Data Min Bioinform (IJDMB). 2015; 13(3): 248–265.

Aziz MAE, Hassanien AE. Modified cuckoo search algorithm with rough sets for feature selection. Neural Comput Appl. 2018; 29(4): 925–934.

Kumar A, Jaiswal A, Garg S, Verma S, Kumar S. Sentiment analysis using cuckoo search for optimized feature selection on kaggle tweets. Int J Inf Retr Res (IJIRR). 2019; 9(1): 1–15.

Emary E, Zawbaa HM, Ghany KKA, Hassanien AE, Paˆrv B. Firefly optimization algorithm for feature selection. In Proceedings of the 7th Balkan Conference on Informatics Conference, BCI’15, Craiova, Romania. 2015 Sep 2–4; 26(7p).

Xu H, Yu S, Chen J, Zuo X. An improved firefly algorithm for feature selection in classification. Wirel Pers Commun. 2018; 102(4): 2823–2834.

Zhang L, Mistry K, Lim CP, Neoh SC. Feature selection using firefly optimization for classification and regression models. Decis Support Syst. 2018; 106: 64–85.

Aljarah I, Al-Zoubi AM, Faris H, Hassonah MA, Mirjalili S, Saadeh H. Simultaneous feature selection and support vector machine optimization using the grasshopper optimization algorithm. Cognit Comput. 2018; 10(3): 478–495.

Mafarja MM, Aljarah I, Faris H, Hammouri AI, Al-Zoubi AM, Mirjalili S. Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl. 2019; 117: 267–286.

Zakeri A, Hokmabadi A. Efficient feature selection method using real-valued grasshopper optimization algorithm. Expert Syst Appl. 2019; 119: 61–72.

Mafarja MM, Aljarah I, Heidari AA, Hammouri AI, Faris H, Al-Zoubi AM, Mirjalili S. Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowl-Based Syst. 2018; 145: 25–45.

Heba FE. Binary whale optimisation: an effective swarm algorithm for feature selection. International Journal of Metaheuristics (IJMHeur). 2018; 7(1): 67–79.

Mafarja MM, Mirjalili S. Whale optimization approaches for wrapper feature selection. Appl Soft Comput. 2018; 62: 441–453.

Xue B, Cervante L, Shang L, Zhang M. A particle swarm optimisation based multi-objective filter approach to feature selection for classification. In PRICAI 2012: Trends in Artificial Intelligence-12th Pacific Rim International Conference on Artificial Intelligence, Kuching, Malaysia, Proceedings. 2012 Sep 3–7; 673–685.

Xue B, Cervante L, Shang L, Browne WN, Zhang M. A multi-objective particle swarm optimisation for filter-based feature selection in classification problems. Connect Sci. 2012; 24(2–3): 91–116. 36. Bing Xue, Liam Cervante, Lin Shang, Browne Will N, Mengjie Zhang. Multi-objective evolutionary algorithms for filter based feature s-election in classification. Int J Artif Intell Tools. 2013; 22(4): 1350024.

Hancer E, Xue B, Zhang M. Differential evolution for filter feature selection based on information theory and feature ranking. Knowl-Based Syst. 2018; 140: 103–119.

Tabakhi S, Moradi P. Relevance-redundancy feature selection based on ant colony optimization. Pattern Recognit. 2015; 48(9): 2798–2811.

Moayedikia A, Jensen R, Wiil UK, Forsati R. Weighted bee colony algorithm for discrete optimization problems with application to feature selection. Eng Appl Artif Intel. 2015; 44: 153–167.

Wang Y, Li Z, Yu H, Deng L. Optimizing cuckoo feature selection algorithm with the new initialization strategy and fitness function. In Cloud Computing and Security-4th International Conference, ICCCS 2018, Haikou, China, June 8–10, 2018, Revised Selected Papers, Part I. 2018; 719–730.

Maldonado S, Lo´pez J. Dealing with high-dimensional class-imbalanced datasets: Embedded feature selection for SVM classification. Appl Soft Comput. 2018; 67: 94–105.

Liu X, Liang Y, Wang S, Yang Z, Ye H. A hybrid genetic algorithm with wrapper-embedded approaches for feature selection. IEEE Access. 2018; 6: 22863–22874.

Muni DP, Pal NR, Das J. Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybern Part B. 2006; 36(1): 106–117.

Lin J, Ke H, Chien B, Yang W. Classifier design with feature selection and feature extraction using layered genetic programming. Expert Syst Appl. 2008; 34(2): 1384–1393.

Bermejo P, Ga´mez JA, Puerta JM. A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets. Pattern Recognit Lett. 2011; 32(5): 701–711.

Butler-Yeoman T, Xue B, Zhang M. Particle swarm optimisation for feature selection: A hybrid filter-wrapper approach. In IEEE Congress on Evolutionary Computation, CEC 2015, Sendai, Japan. 2015 May 25–28; 2428–2435.

Tran B, Zhang M, Xue B. A PSO based hybrid feature selection algorithm for high-dimensional classification. In IEEE Congress on Evolutionary Computation, CEC 2016. 2016; 3801–3808.

Mafarja MM, Mirjalili S. Hybrid binary ant lion optimizer with rough set and approximate entropy reducts for feature selection. Soft Comput. 2018; 23(1): 6249–6265.

Jiang Y, Liu X, Yan G, Xiao J. Modified binary cuckoo search for feature selection: A hybrid filter-wrapper approach. In 13th International Conference on Computational Intelligence and Security, CIS. 2017; 488–491.

Brownlee AI, Regnier-Coudert O, Mccall JW, Massie S, Stulajter S. An application of a ga with markov network surrogate to feature selection. Int J Syst Sci. 2013; 44(11): 2039–2056.

Nguyen BH, Xue B, Andreae P. Surrogate-model based particle swarm optimisation with local search for feature selection in classification. In: Applications of Evolutionary Computation. Cham: Springer; 2017; 487–505.

Nguyen HB, Xue B, Andreae P. PSO with surrogate models for feature selection: static and dynamic clustering-based methods. Memet Comput. 2018; 10(5): 1–10.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Current Trends in Information Technology

  • eISSN: 2249-4707
  • ISSN: 2348-7895