Interpretable machine learning approach for predicting COVID-19 risk status of an individual
DOI:
https://doi.org/10.14738/tnc.92.9760Abstract
This study aimed to ascertained using Statistical feature selection methods and interpretable Machine learning models, the best features that predict risk status (“Low”, “Medium”, “High”) to COVID-19 infection. This study utilizes a publicly available dataset obtained via; online web-based risk assessment calculator to ascertain the risk status of COVID-19 infection. 57 out of 59 features were first filtered for multicollinearity using the Pearson correlation coefficient and further shrunk to 55 features by the LASSO GLM approach. SMOTE resampling technique was used to incur the problem of imbalanced class distribution. The interpretable ML algorithms were implored during the classification phase. The best classifier predictions were saved as a new instance and perturbed using a single Decision tree classifier. To further build trust and explainability of the best model, the XGBoost classifier was used as a global surrogate model to train predictions of the best model. The XGBoost individual’s explanation was done using the SHAP explainable AI-framework. Random Forest classifier with a validation accuracy score of 96.35 % from 55 features reduced by feature selection emerged as the best classifier model. The decision tree classifier approximated the best classifier correctly with a prediction accuracy score of 92.23 % and Matthew’s correlation coefficient of 0.8960. The XGBoost classifier approximated the best classifier model with a prediction score of 99.7 %. This study identified COVID-19 positive, COVID-19 contacts, COVID-19 symptoms, Health workers, and Public transport count as the five most consistent features that predict an individual’s risk exposure to COVID-19.
References
Alistair Martin, Jama Nateqi., (2020). An artificial intelligence-based first-line defense against COVID-19: digitally screening citizens for risks via a chatbot. bioRxiv 2020.03.25.008805; doi: https://doi.org/10.1101/2020.03.25.008805
Azodi, C. B., Tang, J., & Shiu, S. H. (2020). Opening the Black Box: Interpretable machine learning for geneticists. Trends in Genetics.
Boldog, P., Tekeli, T., Vizi, Z., Dénes, A., Bartha, F. A., & Röst, G. (2020). Risk assessment of novel coronavirus COVID-19 outbreaks outside China. Journal of clinical medicine, 9(2), 571.
Centers for Disease Control and Prevention. 2020. Coronavirus Disease 2019 (COVID-19) In The U.S.. [online] Available at: https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/cases-in-us.html [Accessed 25 April 2020].
Centers for Disease Control and Prevention. 2020. Coronavirus Disease 2019 (COVID-19). [online] Available at: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/people-athigher-risk.html[Accessed 25 April 2020].
Centers for Disease Control and Prevention. 2020. Risk Assessment And Management. from https://www.cdc.gov/coronavirus/2019-ncov/php/risk-assessment.html 12
Chen, X., Chughtai, A. A., & MacIntyre, C. R. (2020). Application of a Risk Analysis Tool to Middle East Respiratory Syndrome Coronavirus (MERS‐CoV) Outbreak in Saudi Arabia. Risk Analysis, 40(5), 915-925.
Larsen, K., Petersen, J. H., Budtz‐Jørgensen, E., & Endahl, L. (2000). Interpreting parameters in the logistic regression model with random effects. Biometrics, 56(3), 909-914.
Coronavirus Live Updates: Virus Keeps Spreading as Governments Clamp Down. (2020). Retrieved 9 March 2020, from https://www.nytimes.com/2020/03/09/world/coronavirus-news.html
Fang, L., Karakiulakis, G., & Roth, M. (2020). Are patients with hypertension and diabetes mellitus at increased risk for COVID-19 infection?. The Lancet. Respiratory Medicine, 8(4), e21.
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018, October). Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE 5th International Conference on data science and advanced analytics (DSAA) (pp. 80-89). IEEE.
Grantham, Jonathon. "KNOW YOUR RISK". Nexoid's COVID-19 Survival Calculator, 2020, https://www.covid19survivalcalculator.com/calculator . Accessed 18 May 2020.
Hao, S., Wang, Y., Jin, B., Shin, A. Y., Zhu, C., Huang, M., ... & Ling, X. B. (2015). Development, validation and deployment of a real time 30 day hospital readmission risk assessment tool in the Maine healthcare information exchange. PloS one, 10(10), e0140271.
Hellewell, J., Abbott, S., Gimma, A., Bosse, N., Jarvis, C., & Russell, T. et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. The Lancet Global Health. 2020, doi: 10.1016/s2214109x(20)30074-7
Kailkhura, B., Gallagher, B., Kim, S., Hiszpanski, A., & Han, T. Y. J. (2019). Reliable and explainable machine-learning methods for accelerated material discovery. npj Computational Materials, 5(1), 1-9.
Koh, D. (2020). Occupational risks for COVID-19 infection. Occupational medicine (Oxford, England), 70(1), 3.
Knight, W. (2020). How AI Is Tracking the Coronavirus Outbreak. Retrieved 9 March 2020, from https://www.wired.com/story/how-ai-tracking-coronavirus-outbreak/
Krawczyk, B., Woźniak, M., & Schaefer, G. (2014). Cost-sensitive decision tree ensembles for effective imbalanced classification. Applied Soft Computing, 14, 554-562.
Lo, J. C., Pressman, A. R., Chandra, M., & Ettinger, B. (2011). Fracture risk tool validation in an integrated healthcare delivery system. The American journal of managed care, 17(3), 188-194.
Martin, A., Nateqi, J., Gruarin, S., Munsch, N., Abdarahmane, I., Zobel, M., & Knapp, B. (2020). An artificial intelligence-based first-line defence against COVID-19: digitally screening citizens for risks via a chatbot. Scientific reports, 10(1), 1-7.
McCall, B. (2020). COVID-19 and artificial intelligence: protecting health-care workers and curbing the spread. The Lancet Digital Health, 2(4), e166-e167.
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019). Interpretable machine learning: definitions, methods, and applications. arXiv preprint arXiv:1901.04592.
Qiao, J. (2020). What are the risks of COVID-19 infection in pregnant women?. The Lancet, 395(10226), 760-762.
Roscher, R., Bohn, B., Duarte, M. F., & Garcke, J. (2020). Explainable machine learning for scientific insights and discoveries. IEEE Access, 8, 42200-42216.
Rozenfeld, Y., Beam, J., Maier, H., Haggerson, W., Boudreau, K., Carlson, J., & Medows, R. (2020). A model of disparities: risk factors associated with COVID-19 infection. International journal for equity in health, 19(1), 1-10.
Shereen, M. A., Khan, S., Kazmi, A., Bashir, N., & Siddique, R. (2020). COVID-19 infection: Origin, transmission, and characteristics of human coronaviruses. Journal of Advanced Research.
Sudjianto, A., Knauth, W., Singh, R., Yang, Z., & Zhang, A. (2020). Unwrapping The Black Box of Deep ReLU Networks: Interpretability, Diagnostics, and Simplification. arXiv preprint arXiv:2011.04041.
Sun, Yijun, Sinisa Todorovic, and Steve Goodison. "Local-learning-based feature selection for highdimensional data analysis." IEEE transactions on pattern analysis and machine intelligence 32.9 (2009): 1610-1626.
Tian, S., Hu, N., Lou, J., Chen, K., Kang, X., Xiang, Z., ... & Chen, G. (2020). Characteristics of COVID-19 infection in Beijing. Journal of Infection.
Udugama, B., Kadhiresan, P., Kozlowski, H. N., Malekjahani, A., Osborne, M., Li, V. Y., ... & Chan, W. C. (2020). Diagnosing COVID-19: the disease and tools for detection. ACS nano, 14(4), 3822-3835.
World Health Organization. Coronavirus. Retrieved 9 March 2020, from https://www.who.int/health-topics/coronavirus
Writer, R. How effective are travel bans for curbing coronavirus spread?. Retrieved 9 March 2020, from https://www.livescience.com/coronavirus-travel-restrictions-effectiveness.html
Xu, B., Gutierrez, B., Mekaru, S., Sewalk, K., Goodwin, L., Loskill, A., ... & Kraemer, M. U. (2020). Epidemiological data from the COVID-19 outbreak, real-time case information. Scientific data, 7(1), 1-6.
Xu, B., Kraemer, M. U., Gutierrez, B., Mekaru, S., Sewalk, K., Loskill, A., ... & Kraemer, M. (2020). Open access epidemiological data from the COVID-19 outbreak. The Lancet Infectious Diseases, 20(5), 534.
Yan, L., Zhang, H. T., Goncalves, J., Xiao, Y., Wang, M., Guo, Y., ... & Huang, X. (2020). An interpretable mortality prediction model for COVID-19 patients. Nature Machine Intelligence, 1-6.
Zhao, Z., Morstatter, F., Sharma, S., Alelyani, S., Anand, A., & Liu, H. (2010). Advancing feature selection research. ASU feature selection repository, 1-28
Zietz, M., & Tatonetti, N. P. (2020). Testing the association between blood type and COVID-19 infection, intubation, and death. MedRxiv.
Zou, Q., Xie, S., Lin, Z., Wu, M., & Ju, Y. (2016). Finding the best classification threshold in imbalanced classification. Big Data Research, 5, 2-8.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Anthony Onoja, Mary Oyinlade Ejiwale, Ayesan Rewane

This work is licensed under a Creative Commons Attribution 4.0 International License.