A Modified Metaheuristic Algorithm Integrated ELM model for Cancer Classification

Document Type : Article

Authors

Department of Computer Science and Engineering, International Institute of Information Technology Bhubaneswar, Odisha, India, 751019

Abstract

Background: In the rapidly defiled environment, cancer has emerged out as the most threatening disease to human species. Therefore, a robust classification model is required to diagnose cancer with high accuracy and less computational complexity.
Method: Here, random parameters of Extreme Learning Machine (ELM) are optimized by Self Adaptive Multi-Population-based Elite strategy Jaya (SAMPEJ) algorithm. This strategy constructs a robust ELM classifier named as SAMPEJ-ELM model. This model is tested on Breast cancer, Cervical cancer and Lung cancer datasets. Here, a comparative analysis is presented between the proposed model and basic ELM, Jaya optimized ELM (Jaya-ELM), Teaching Learning Based Optimization (TLBO) optimized ELM (TLBO-ELM), SAMPEJ optimized Neural Network (SAMPEJ-NN), SAMPEJ optimized Functional Link Artificial Neural Network (SAMPEJ-FLANN) models. Numerous performance metrices viz. accuracy, specificity, Gmean, sensitivity, F-score with receiver operating characteristic (ROC) curve are used to estimate the proposed model. Moreover, this model is compared with eleven existing models.
Results: SAMPEJ-ELM model resulted the highest degree of accuracy, sensitivity and specificity in Breast Cancer (.9895, 1, .9853), Cervical Cancer (.9822, .9948, .9828), Lung cancer (.9787, 1, 1) datasets.
Conclusion: The experimental results reveal that SAMPEJ-ELM model classifies both the positive and negative samples of cancer datasets significantly better than others.

Keywords


References:
[1]     Parkin, D. Maxwell, Freddie Bray, Jacques Ferlay, and Paola Pisani. “Estimating the world cancer burden: Globocan 2000”, International journal of cancer 94(2), pp. 153-156 (2001).
[2]    Cooper, J.S., Porter, K., Mallin, K., Hoffman, H.T., Weber, R.S., Ang, K.K., Gay, E.G. and Langer, C.J. “National Cancer Database report on cancer of the head and neck: 10‐year update”, Head & Neck: Journal for the Sciences and Specialties of the Head and Neck, 31(6), pp.748-758 (2009).
[3]    Duda, R.O. and Hart, P.E. “Pattern classification”, John Wiley & Sons (2006).
[4]    Zurada, J.M. “Introduction to artificial neural systems’’ (Vol. 8), St. Paul: West (1992).
[5]    Naik, B., Nayak, J., Behera, H.S. and Abraham, A. “A harmony search based gradient descent learning-FLANN (HS-GDL-FLANN) for classification”, In Computational Intelligence in Data Mining, (Vol. 2), pp. 525-539. Springer, New Delhi (2015).
[6]    Bahrololoum, A., Nezamabadi-Pour, H., Bahrololoum, H. and Saeed, M. “A prototype classifier based on gravitational search algorithm”, Applied Soft Computing, 12(2), pp.819-825 (2012).
[7]    Fernández-Navarro, F., Hervás-Martínez, C., Ruiz, R. and Riquelme, J.C. “Evolutionary generalized radial basis function neural networks for improving prediction accuracy in gene classification using feature selection”, Applied Soft Computing, 12(6), pp.1787-1800 (2012).
[8]     Aydogan, E.K., Karaoglan, I. and Pardalos, P.M. “hGA: Hybrid genetic algorithm in fuzzy rule-based classification systems for high-dimensional problems”, Applied Soft Computing, 12(2), pp.800-806 (2012).
[9]    Heermann, P.D. and Khazenie, N. “Classification of multispectral remote sensing data using a back-propagation neural network”, IEEE Transactions on geoscience and remote sensing, 30(1), pp.81-88 (1992).
[10]    Malathi, V., Marimuthu, N.S. and Baskar, S. “Intelligent approaches using support vector machine and extreme learning machine for transmission line protection”, Neurocomputing, 73(10-12), pp.2160-2167 (2010).
[11]    Cristianini, N. and Shawe-Taylor, J. “An introduction to support vector machines and other kernel-based learning methods”, Cambridge university press (2000).
[12]    Huang, G. B., Zhu, Q. Y., and Siew, C. K. “Extreme learning machine: theory and applications”, Neurocomputing, 70(1-3), 489-501 (2006).
[13]    Huang, G.B., Zhu, Q.Y. and Siew, C.K. “Extreme learning machine: a new learning scheme of feedforward neural networks”, IEEE international joint conference on neural networks (IEEE Cat. No. 04CH37541) vol. 2, pp. 985-990 (2004).
[14]     Huang, G.B., Zhou, H., Ding, X. and Zhang, R. “Extreme learning machine for regression and multiclass classification”, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(2), pp.513-529 (2011).
[15]    Huang, G. B., Wang, D. H., and Lan, Y. “Extreme learning machines: a survey. International journal of machine learning and cybernetics”, 2(2), 107-122 (2011).
[16]    Wang, D., and Alhamdoosh, M. “Evolutionary extreme learning machine ensembles with size control”, Neurocomputing, 102, 98-110 (2013).
[17]    Huang, G. B., and Wang, D. “Advances in extreme learning machines (ELM2010)”, Neurocomputing, 16(74), 2411-2412 (2011).
[18]    Feng, G., Huang, G.B., Lin, Q. and Gay, R. “Error minimized extreme learning machine with growth of hidden nodes and incremental learning”,  IEEE Transactions on Neural Networks, 20(8), pp.1352-1357 (2009).
[19]    Zhao, G., Shen, Z., Miao, C., and Man, Z. “On improving the conditioning of extreme learning machine: a linear case”, In 2009 7th International Conference on Information, Communications and Signal Processing (ICICS), pp. 1-5, IEEE (2009).
[20]    Chen, C. P., and Wan, J. Z. “A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction”, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 29(1), 62-72 (1999).
[21]    Pacifico, L. D., and Ludermir, T. B. “Improved evolutionary extreme learning machines based on particle swarm optimization and clustering approaches”, International Journal of Natural Computing Research (IJNCR), 3(3), 1-20 (2012).
[22]    Han, F., Yao, H. F., and Ling, Q. H. “An improved evolutionary extreme learning machine based on particle swarm optimization”, Neurocomputing, 116, 87-93 (2013).
[23]    Baliarsingh, S. K., and Vipsita, S. “Chaotic emperor penguin optimised extreme learning machine for microarray cancer classification”, IET Syst Biol, 14(2), 85-95 (2020).
[24]     Feng, G., Huang, G.B., Lin, Q. and Gay, R. “Error minimized extreme learning machine with growth of hidden nodes and incremental learning”, IEEE Transactions on Neural Networks, 20(8), pp.1352-1357 (2009).
[25]    Zhu, Q.Y., Qin, A.K., Suganthan, P.N. and Huang, G.B. “Evolutionary extreme learning machine. Pattern recognition”, 38(10), pp.1759-1763 (2005).
[26]    Yang, X. S., and Deb, S. “Multiobjective cuckoo search for design optimization”, Computers & Operations Research, 40(6), 1616-1624 (2013)..
[27]    Aha, D. W. “Tolerating noisy, irrelevant and novel attributes in instance-based learning algorithms”, International Journal of Man-Machine Studies, 36(2), 267-287 (1992).
[28]    Rashno, A., Nazari, B., Sadri, S. and Saraee, M. “Effective pixel classification of mars images based on ant colony optimization feature selection and extreme learning machine”, Neurocomputing, 226, pp.66-79 (2017).
[29]    Mohapatra, P., Chakravarty, S., and Dash, P. K. “An improved cuckoo search based extreme learning machine for medical data classification”, Swarm and Evolutionary Computation, 24, 25-49 (2015).
[30]    Mohapatra, P., Chakravarty, S., and Dash, P. K. “Microarray medical data classification using kernel ridge regression and modified cat swarm optimization based gene selection system”, Swarm and Evolutionary Computation, 28, 144-160 (2016).
[31]    Rao, R. “Jaya: A simple and new optimization algorithm for solving constrained and unconstrained optimization problems”, International Journal of Industrial Engineering Computations, 7(1), 19-34 (2016).
[32]    Rao, R. V., Savsani, V. J., and Vakharia, D. P. “Teaching–learning-based optimization: an optimization method for continuous non-linear large scale problems”, Information sciences, 183(1), 1-15 (2012).
[33]    Rao, R.V., More, K., Taler, J. and Ocłoń, P. “Dimensional optimization of a micro-channel heat sink using Jaya algorithm”, Applied Thermal Engineering, 103, 572-582 (2016)..
[34]    Warid, W., Hizam, H., Mariun, N. and Abdul-Wahab, N.I. “Optimal power flow using the Jaya algorithm”, Energies, 9(9), p.678 (2016).
[35]    Wang, S.H., Phillips, P., Dong, Z.C. and Zhang, Y.D. “Intelligent facial emotion recognition based on stationary wavelet entropy and Jaya algorithm”, Neurocomputing, 272, pp.668-676 (2018).
[36]    Wang, S., Rao, R.V., Chen, P., Zhang, Y., Liu, A. and Wei, L. “Abnormal breast detection in mammogram images by feed-forward neural network trained by Jaya algorithm”, Fundamenta Informaticae, 151(1-4), pp.191-211 (2017).
[37]    Das, S.R., Mishra, D. and Rout, M. “A hybridized ELM-Jaya forecasting model for currency exchange prediction”, Journal of King Saud University-Computer and Information Sciences, 32(3), pp.345-366 (2020).
[38]    Li, C., Nguyen, T.T., Yang, M., Yang, S. and Zeng, S. “Multi-population methods in unconstrained continuous dynamic environments: The challenges”, Information Sciences, 296, pp.95-118 (2015).
[39]    Branke, J., Kaußler, T., Smidt, C. and Schmeck, H. “A multi-population approach to dynamic optimization problems”, In Evolutionary design and manufacture (pp. 299-307). Springer, London (2000).
[40]    Du, W. and Li, B. “Multi-strategy ensemble particle swarm optimization for dynamic optimization”, Information sciences, 178(15), pp.3096-3109 (2008).
[41]    Yang, S. and Li, C. “A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments”, IEEE Transactions on Evolutionary Computation, 14(6), 959-974 (2010).
[42]    Rao, R. and Patel, V. “An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems”, international journal of industrial engineering computations, 3(4), pp.535-560 (2012).
[43]    Rao, R. V. and Saroj, A. “An elitism-based self-adaptive multi-population Jaya algorithm and its applications”, Soft Computing, 23(12), 4383-4406 (2019).
[44]    Venkata Rao, R., Saroj, A. and Bhattacharyya, S. “Design optimization of heat pipes using elitism-based self-adaptive multipopulation Jaya algorithm”, Journal of Thermophysics and Heat Transfer, 32(3), 702-712 (2018).
[45]    https://archive.ics.uci.edu/ml/index.php 
[46]    Dehuri, S., Roy, R., Cho, S.B. and Ghosh, A. “An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification”, Journal of Systems and Software, 85(6), pp.1333-1345 (2012).
[47]    Rao, R. V. and Kalyankar, V. D. “Parameters optimization of advanced machining processes using TLBO algorithm”, EPPM, Singapore, 20, 21-31(2011).
[48]    Aruna, S., Rajagopalan, S. P. and Nandakishore, L. V. “Knowledge based analysis of various statistical tools in detecting breast cancer”, Computer Science & Information Technology, 2(2011), 37-45 (2011).
[49]    Ceylan, Z. and Pekel, E. “Comparison of multi-label classification methods for prediagnosis of cervical cancer”, graphical models, 21, 22 (2017).
[50]    Christobel, Angeline, and Y. Sivaprakasam. “An empirical comparison of data mining classification methods”, International Journal of Computer Information Systems 3.2, pp.24-28 (2011).
[51]    Luukka, P. “Similarity classifier using similarity measure derived from Yu's norms in classification of medical data sets”, Computers in Biology and Medicine, 37(8), 1133-1140 (2007).
[52]    Yang, W., Gou, X., Xu, T., Yi, X. and Jiang, M. “May. Cervical cancer risk prediction model and analysis of risk factors based on machine learning”, In Proceedings of the 2019 11th International Conference on Bioinformatics and Biomedical Technology, pp. 50-54 (2019).
[53]    Lavanya, D. and Rani, D. K. U. “Analysis of feature selection with classification: Breast cancer datasets”, Indian Journal of Computer Science and Engineering (IJCSE), 2(5), 756-763 (2011).
[54]    Naseriparsa, M. and Kashani, M. M. R. “Combination of PCA with SMOTE resampling to boost the prediction rate in lung cancer dataset”, arXiv preprint arXiv:1403.1949 (2014).
[55]    Nasution, M. Z. F., Sitompul, O. S. and Ramli, M. “PCA based feature reduction to improve the accuracy of decision tree c4. 5 classification”, In Journal of Physics: Conference Series, 978(1), pp. 012058 (2018).
[56]    Salama, G. I., Abdelhalim, M. and Zeid, M. A. E. “Breast cancer diagnosis on three different datasets using multi-classifiers”, Breast Cancer (WDBC), 32(569), 2 (2012).
[57]    Alharbi, A. “An Automated Computer System Based on Genetic Algorithm and Fuzzy Systems for Lung Cancer Diagnosis”, International Journal of Nonlinear Sciences and Numerical Simulation, 19(6), 583-594 (2018).
[58]    Prabadevi, B., Deepa, N., Krithika, L.B. and Vinod, V. “Analysis of machine learning algorithms on cancer dataset”, In 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), IEEE, pp. 1-10 (2020).