Comparing Feature Selection Methods on Metagenomic Data using Random Forest Classifier
DOI:
https://doi.org/10.14738/tecs.121.16525Keywords:
Feature Selection, Metagenomics, Random Forest, Ensemble feature selectionAbstract
Feature selection (FS) as a data preprocessing strategy is an efficient way to prepare input data for various fields, such as metagenomics, where datasets tend to be very high-dimensional. The objectives of feature selection include creating lower dimensional and cleaner input data, along with building simpler and more coherent machine learning models. One of the promising applications of machine learning is in precision medicine, where disease risk is predicted using patient genetic data, which needs to be preprocessed with feature selection. In this article we provide a general overview of different feature selection methods and their applicability for disease risk prediction. From these, we selected and compared six different FS methods on two freely available metagenomic datasets using the same machine learning algorithm (Random Forest) for comparability. Based on the results of the individual FS methods, ensemble feature sets were created in multiple ways to improve the accuracy of Random Forest predictions.
References
Berisha, V., Krantsevich, C., Hahn, P.R. et al. Digital medicine and the curse of dimensionality. npj Digit. Med. 2021; 4:153, https://doi.org/10.1038/s41746-021-00521-5.
Jundong Li, Kewei Cheng, Suhang Wang, Fred Morstatter, Robert P. Trevino, Jiliang Tang, and Huan Liu. Feature Selection: A Data Perspective. ACM Comput. Surv. 2018;50:6, https://doi.org/10.1145/3136625.
Wooley J C, Godzik A, Friedberg I. “A Primer on Metagenomics,” PLoS Computational Biology 2010; 6(2); https://doi.org/10.1371/journal.pcbi.1000667
Spiegel, A. M., and Hawkins, M. ’Personalized Medicine’ to Identify Genetic Risks for Type 2 Diabetes and Focus Prevention: Can it Fulfill its Promise? Health Aff. (Millwood), 2012;31:43–49. doi:10.1377/hlthaff.2011.1054.
Manolio, T. A. Bringing Genome-wide Association Findings into Clinical Use. Nat. Rev. Genet. 2013;14:549–558. doi:10.1038/nrg3523.
Oulas A, Pavloudi C, Polymenakou p, Pavlopoulos G A, Papanikolaou N, Kotoulas G, et al., “Metagenomics: Tools and Insights for Analyzing Next-Generation Sequencing Data Derived from Biodiversity Studies,” Bioinformatics and Biology Insights 2015;9:75-88, doi: 10.4137/BBI.S12462
Oudah M, Henschel A. “Taxonomy-aware feature engineering for microbiome classification,” BMC Bioinformatics 2018;19:227
Zhu Q, Li B, He T, Li G, Jiang X. Robust biomarker discovery for microbiome-wide association studies. Methods 2020;173:44–51. DOI: 10.1016/j.ymeth.2019.06.012
Lai K, Twine N, O'Brien A, Guo Y, Bauer D. Artificial Intelligence and Machine Learning in Bioinformatics. Encyclopedia of Bioinformatics and Computational Biology, Elsevier, 2019, p. 272–286.
Tadist K, Najah S, Nikolov N S, Mrabti F, Zahi A. Feature selection methods and genomic big data: a systematic review. Journal of Big Data 2019;6:79. https://doi.org/10.1186/s40537-019-0241-0
Berrar D, Bradbury I, Dubitzky W. Avoiding model selection bias in small-sample genomic datasets. Bioinformatics. 2006;22:10:1245.12.
Pudjihartono N, Fadason T, Kempa-Liehr A W, O'Sullivan J M. A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Frontiers in Bioinformatics 2022;2. doi: 10.3389/fbinf.2022.927312
Hacilar H, Nalbantoglu O U, Bakir-Gungor B. Machine Learning Analysis of Inflammatory Bowel Disease-Associated Metagenomics Dataset. 3rd International Conference on Computer Science and Engineering (UBMK), 2018. URL: http://dx.doi.org/10.14738/tecs.121.16525 185
Urbanowicz R J, Olson R S, Schmitt P, Meeker M, Moore J H. Benchmarking relief-based feature selection methods for bioinformatics data mining. Journal of Biomedical Informatics 2018; vol. 85:168–188. https://doi.org/10.1016/j.jbi.2018.07.015
He D, Rish I, Haws D. Parida L. MINT: Mutual Information Based Transductive Feature Selection for Genetic Trait Prediction. IEEE/ACM Transactions on Computational Biology and Bioinformatics 2016; vol. 13:578–583. https://doi.org/10.48550/arXiv.1310.1659
Kavakiotis I, Samaras P, Triantafyllidis A. Vlahavas I. FIFS: A data mining method for informative marker selection in high dimensional population genomic data. Computers in Biology and Medicine 2017;vol. 90:146–154. https://doi.org/10.1016/j.compbiomed.2017.09.020
Shen Y, Xu J, Li Z, Huang Y, Yuan Y, Wang J, et al. Analysis of gut microbiota diversity and auxiliary diagnosis as a biomarker in patients with schizophrenia: A cross-sectional study. Schizophrenia Research 2018;vol. 197:470–477. DOI: 10.1016/j.schres.2018.01.002
Kumar M, Rath S K. Classification of microarray using MapReduce based proximal support vector machine classifier. Knowledge-Based Systems 2015; vol. 89:584–602.
Sasikala S, Balamurugan S A, Geetha S. A Novel Feature Selection Technique for Improved Survivability Diagnosis of Breast Cancer. Procedia Computer Science 2015;vol. 50:16–23. https://doi.org/10.1016/j.procs.2015.04.005
Jafari M, Ghavami B, Sattari V. A hybrid framework for reverse engineering of robust Gene Regulatory Networks. Artificial Intelligence in Medicine 2017;vol. 79:15–27. https://doi.org/10.1016/j.artmed.2017.05.004
Wang S, Cai Y. Identification of the functional alteration signatures across different cancer types with support vector machine and feature analysis. Biochimica et Biophysica Acta (BBA) - Molecular Basis of Disease 2018;vol. 1864:2218–2227. DOI: 10.1016/j.bbadis.2017.12.026
Verma S S, Lucas A, Zhang X, Veturi Y, Dudek S, Li B, et al. Collective feature selection to identify crucial epistatic variants. BioData Mining 2018;vol. 11:5 DOI: 10.1186/s13040-018-0168-6
Farid D M, Nowe A, Manderick B. A feature grouping method for ensemble clustering of high-dimensional genomic big data. Future Technologies Conference (FTC), 2016. doi: 10.1109/FTC.2016.7821620
Sarkar J P, Saha I, Sarkar A, Maulik U. Machine learning integrated ensemble of feature selection methods followed by survival analysis for predicting breast cancer subtype specific miRNA biomarkers. Computers in Biology and Medicine 2021;vol. 131:104-244. DOI: 10.1016/j.compbiomed.2021.104244
Chen X, Ishwaran H. Random forests for genomic data analysis, Genomics 2012;vol. 99:6:323-329, ISSN 0888-7543, https://doi.org/10.1016/j.ygeno.2012.04.003.
Gao Y, Zhu Z, Sun F. Increasing prediction performance of colorectal cancer disease status using random forests classification based on metagenomic shotgun sequencing data. Synthetic and Systems Biotechnology 2022; vol 7:574–585. https://doi.org/10.1016/j.synbio.2022.01.005
Degenhardt F, Seifert S, Szymczak S. Evaluation of variable selection methods for random forests and omics data sets. Brief Bioinform. 2019; vol. 20(2):492-503. doi: 10.1093/bib/bbx124.
Ai D, Pan H, Han R, Li X, Liu G, Xia LC. Using Decision Tree Aggregation with Random Forest Model to Identify Gut Microbes Associated with Colorectal Cancer. Genes (Basel) 2019; vol 10(2):112. doi:
Shen J, McFarland A G, Blaustein R A et al. An improved workflow for accurate and robust healthcare environmental surveillance using metagenomics. Microbiome 2022; vol 10. https://doi.org/10.1186/s40168-022-01412-x
Montesinos L, Montesinos López O A, Crossa A. Random Forest for Genomic Prediction. In: Multivariate Statistical Machine Learning Methods for Genomic Prediction. Springer, Cham. 2022; https://doi.org/10.1007/978-3-030-89010-0_15
Hill-Burns E M, Debelius J W, Morton J M, Wissemann W T, Lewis M R, Wallen Z D, et al. Parkinson's disease and Parkinson's disease medications have distinct signatures of the gut microbiome. Movement Disorders 2017;vol. 32:739–749. DOI: 10.1002/mds.26942
Zeller G, Tap J, Voigt A Y, Sunagawa S, Kultima J R, Costea P I, et al. Potential of fecal microbiota for earlystage detection of colorectal cancer. Molecular Systems Biology 2014;vol. 10:766. doi: 10.15252/msb.20145645
Qu K, Gao F, Guo F, Zou Q. Taxonomy dimension reduction for colorectal cancer prediction. Computational Biology and Chemistry 2019;vol. 83:107-160. DOI: 10.1016/j.compbiolchem.2019.107160
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 2011;vol. 12:2825-2830.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Zoltán Pödör, Máté Hekfusz

This work is licensed under a Creative Commons Attribution 4.0 International License.