Comparing Feature Selection Methods on Metagenomic Data using Random Forest Classifier

Authors

  • Zoltán Pödör Eötvös Loránd University, Faculty of Informatics, Budapest, H-1117, Hungary
  • Máté Hekfusz Eötvös Loránd University, Faculty of Informatics, Budapest, H-1117, Hungary

DOI:

https://doi.org/10.14738/tecs.121.16525

Keywords:

Feature Selection, Metagenomics, Random Forest, Ensemble feature selection

Abstract

Feature selection (FS) as a data preprocessing strategy is an efficient way to prepare input data for various fields, such as metagenomics, where datasets tend to be very high-dimensional. The objectives of feature selection include creating lower dimensional and cleaner input data, along with building simpler and more coherent machine learning models. One of the promising applications of machine learning is in precision medicine, where disease risk is predicted using patient genetic data, which needs to be preprocessed with feature selection. In this article we provide a general overview of different feature selection methods and their applicability for disease risk prediction. From these, we selected and compared six different FS methods on two freely available metagenomic datasets using the same machine learning algorithm (Random Forest) for comparability. Based on the results of the individual FS methods, ensemble feature sets were created in multiple ways to improve the accuracy of Random Forest predictions.

References

Berisha, V., Krantsevich, C., Hahn, P.R. et al. Digital medicine and the curse of dimensionality. npj Digit. Med. 2021; 4:153, https://doi.org/10.1038/s41746-021-00521-5.

Jundong Li, Kewei Cheng, Suhang Wang, Fred Morstatter, Robert P. Trevino, Jiliang Tang, and Huan Liu. Feature Selection: A Data Perspective. ACM Comput. Surv. 2018;50:6, https://doi.org/10.1145/3136625.

Wooley J C, Godzik A, Friedberg I. “A Primer on Metagenomics,” PLoS Computational Biology 2010; 6(2); https://doi.org/10.1371/journal.pcbi.1000667

Spiegel, A. M., and Hawkins, M. ’Personalized Medicine’ to Identify Genetic Risks for Type 2 Diabetes and Focus Prevention: Can it Fulfill its Promise? Health Aff. (Millwood), 2012;31:43–49. doi:10.1377/hlthaff.2011.1054.

Manolio, T. A. Bringing Genome-wide Association Findings into Clinical Use. Nat. Rev. Genet. 2013;14:549–558. doi:10.1038/nrg3523.

Oulas A, Pavloudi C, Polymenakou p, Pavlopoulos G A, Papanikolaou N, Kotoulas G, et al., “Metagenomics: Tools and Insights for Analyzing Next-Generation Sequencing Data Derived from Biodiversity Studies,” Bioinformatics and Biology Insights 2015;9:75-88, doi: 10.4137/BBI.S12462

Oudah M, Henschel A. “Taxonomy-aware feature engineering for microbiome classification,” BMC Bioinformatics 2018;19:227

Zhu Q, Li B, He T, Li G, Jiang X. Robust biomarker discovery for microbiome-wide association studies. Methods 2020;173:44–51. DOI: 10.1016/j.ymeth.2019.06.012

Lai K, Twine N, O'Brien A, Guo Y, Bauer D. Artificial Intelligence and Machine Learning in Bioinformatics. Encyclopedia of Bioinformatics and Computational Biology, Elsevier, 2019, p. 272–286.

Tadist K, Najah S, Nikolov N S, Mrabti F, Zahi A. Feature selection methods and genomic big data: a systematic review. Journal of Big Data 2019;6:79. https://doi.org/10.1186/s40537-019-0241-0

Berrar D, Bradbury I, Dubitzky W. Avoiding model selection bias in small-sample genomic datasets. Bioinformatics. 2006;22:10:1245.12.

Pudjihartono N, Fadason T, Kempa-Liehr A W, O'Sullivan J M. A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Frontiers in Bioinformatics 2022;2. doi: 10.3389/fbinf.2022.927312

Hacilar H, Nalbantoglu O U, Bakir-Gungor B. Machine Learning Analysis of Inflammatory Bowel Disease-Associated Metagenomics Dataset. 3rd International Conference on Computer Science and Engineering (UBMK), 2018. URL: http://dx.doi.org/10.14738/tecs.121.16525 185

Urbanowicz R J, Olson R S, Schmitt P, Meeker M, Moore J H. Benchmarking relief-based feature selection methods for bioinformatics data mining. Journal of Biomedical Informatics 2018; vol. 85:168–188. https://doi.org/10.1016/j.jbi.2018.07.015

He D, Rish I, Haws D. Parida L. MINT: Mutual Information Based Transductive Feature Selection for Genetic Trait Prediction. IEEE/ACM Transactions on Computational Biology and Bioinformatics 2016; vol. 13:578–583. https://doi.org/10.48550/arXiv.1310.1659

Kavakiotis I, Samaras P, Triantafyllidis A. Vlahavas I. FIFS: A data mining method for informative marker selection in high dimensional population genomic data. Computers in Biology and Medicine 2017;vol. 90:146–154. https://doi.org/10.1016/j.compbiomed.2017.09.020

Shen Y, Xu J, Li Z, Huang Y, Yuan Y, Wang J, et al. Analysis of gut microbiota diversity and auxiliary diagnosis as a biomarker in patients with schizophrenia: A cross-sectional study. Schizophrenia Research 2018;vol. 197:470–477. DOI: 10.1016/j.schres.2018.01.002

Kumar M, Rath S K. Classification of microarray using MapReduce based proximal support vector machine classifier. Knowledge-Based Systems 2015; vol. 89:584–602.

Sasikala S, Balamurugan S A, Geetha S. A Novel Feature Selection Technique for Improved Survivability Diagnosis of Breast Cancer. Procedia Computer Science 2015;vol. 50:16–23. https://doi.org/10.1016/j.procs.2015.04.005

Jafari M, Ghavami B, Sattari V. A hybrid framework for reverse engineering of robust Gene Regulatory Networks. Artificial Intelligence in Medicine 2017;vol. 79:15–27. https://doi.org/10.1016/j.artmed.2017.05.004

Wang S, Cai Y. Identification of the functional alteration signatures across different cancer types with support vector machine and feature analysis. Biochimica et Biophysica Acta (BBA) - Molecular Basis of Disease 2018;vol. 1864:2218–2227. DOI: 10.1016/j.bbadis.2017.12.026

Verma S S, Lucas A, Zhang X, Veturi Y, Dudek S, Li B, et al. Collective feature selection to identify crucial epistatic variants. BioData Mining 2018;vol. 11:5 DOI: 10.1186/s13040-018-0168-6

Farid D M, Nowe A, Manderick B. A feature grouping method for ensemble clustering of high-dimensional genomic big data. Future Technologies Conference (FTC), 2016. doi: 10.1109/FTC.2016.7821620

Sarkar J P, Saha I, Sarkar A, Maulik U. Machine learning integrated ensemble of feature selection methods followed by survival analysis for predicting breast cancer subtype specific miRNA biomarkers. Computers in Biology and Medicine 2021;vol. 131:104-244. DOI: 10.1016/j.compbiomed.2021.104244

Chen X, Ishwaran H. Random forests for genomic data analysis, Genomics 2012;vol. 99:6:323-329, ISSN 0888-7543, https://doi.org/10.1016/j.ygeno.2012.04.003.

Gao Y, Zhu Z, Sun F. Increasing prediction performance of colorectal cancer disease status using random forests classification based on metagenomic shotgun sequencing data. Synthetic and Systems Biotechnology 2022; vol 7:574–585. https://doi.org/10.1016/j.synbio.2022.01.005

Degenhardt F, Seifert S, Szymczak S. Evaluation of variable selection methods for random forests and omics data sets. Brief Bioinform. 2019; vol. 20(2):492-503. doi: 10.1093/bib/bbx124.

Ai D, Pan H, Han R, Li X, Liu G, Xia LC. Using Decision Tree Aggregation with Random Forest Model to Identify Gut Microbes Associated with Colorectal Cancer. Genes (Basel) 2019; vol 10(2):112. doi:

Shen J, McFarland A G, Blaustein R A et al. An improved workflow for accurate and robust healthcare environmental surveillance using metagenomics. Microbiome 2022; vol 10. https://doi.org/10.1186/s40168-022-01412-x

Montesinos L, Montesinos López O A, Crossa A. Random Forest for Genomic Prediction. In: Multivariate Statistical Machine Learning Methods for Genomic Prediction. Springer, Cham. 2022; https://doi.org/10.1007/978-3-030-89010-0_15

Hill-Burns E M, Debelius J W, Morton J M, Wissemann W T, Lewis M R, Wallen Z D, et al. Parkinson's disease and Parkinson's disease medications have distinct signatures of the gut microbiome. Movement Disorders 2017;vol. 32:739–749. DOI: 10.1002/mds.26942

Zeller G, Tap J, Voigt A Y, Sunagawa S, Kultima J R, Costea P I, et al. Potential of fecal microbiota for earlystage detection of colorectal cancer. Molecular Systems Biology 2014;vol. 10:766. doi: 10.15252/msb.20145645

Qu K, Gao F, Guo F, Zou Q. Taxonomy dimension reduction for colorectal cancer prediction. Computational Biology and Chemistry 2019;vol. 83:107-160. DOI: 10.1016/j.compbiolchem.2019.107160

Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 2011;vol. 12:2825-2830.

Downloads

Published

2024-02-29

How to Cite

Pödör, Z., & Hekfusz, M. (2024). Comparing Feature Selection Methods on Metagenomic Data using Random Forest Classifier. Transactions on Engineering and Computing Sciences, 12(1), 175–187. https://doi.org/10.14738/tecs.121.16525