Power DataMate Tool: Leveraging Logistic Regression Classification for Interactive Data Modeling

Authors

  • Mahmoud Abu Alrub The Electrical and Computer Engineering Department, The University of Michigan – Dearborn, USA https://orcid.org/0000-0002-8916-0259
  • Adnan Shaout The Electrical and Computer Engineering Department, The University of Michigan – Dearborn, USA

DOI:

https://doi.org/10.14738/tecs.122.16892

Keywords:

Data Mining, Data Modeling, Data Classification, Logistic Regression, Primary Key, Foreign Key

Abstract

The demand for efficient predictive modeling techniques has become crucial due to the growing occurrence of binary classification problems in diverse fields. This paper presents a new and innovative software tool “Power DataMate” (PDM) which performs logistic regression (LR) classification as a potent technique for data modeling. PDM is a powerful tool in capturing and analyzing correlations across varied datasets. One objective of PDM is to focus on logistic regression for inquiry based on its capability to represent intricate interactions between predictors and the binary response variable. Another important goal of the new tool is to forecast the likelihood of discovering Primary Keys (PK) and Foreign Keys (FK) within datasets.

The new tool PDM also allows users not only to automatically have their data for a project modeled, but also interactively review and confirm primary keys and features for further data analysis and modeling. While the research entails a comprehensive evaluation of model performance indicators, including accuracy, precision, and recall, results show that the accuracy of PK prediction is 89% and 82% for the FK. Hence, these results are the first of their kind and could be a starting point for further model enhancements and data analytics research, especially for projects which include large data files where PDM end user has the choice to interactively feed the learning algorithm for better outcomes.

References

Fatih Ertam and Galip Aydin, Data Classification with Deep Learning using Tensorflow, 2nd International Conference on Computer Science and Engineering, IEEE, 2017.

Hosmer and Lemeshow, Applied Logistic Regression, 2nd Ed., New York, Wiley, 2000.

Yan, Lee, and Koc, Predictive Algorithm for Machine Degradation Detection Using Logistic Regression, Fifth International Conference on Managing Innovations in Manufacturing (MIM), WI, 2002.

Graeme Simsion and Graham Witt, Data Modeling Essentials, Elsevier, 2005.

Charu C. Aggarwal, Data Mining-The Textbook, Springer, January 2015.

Maglogiannis, Karpouzis, Wallace, and Soldatos, Emerging Artificial Intelligence Applications in Computer Engineering, IOS Press, October 2007.

Stephan Dreiseitl and Lucila Machado, Logistic Regression and Artificial Neural Network Classification Models: A Methodology Review, Journal of Biomedical Informatics 35, USA, 2002.

Ming-Syan Chen, Jiawei Han, and Philip S. Yu, Data Mining: An Overview from a Database Perspictive, IEEE Transaction on KD and Data Engineering, Vol 8, No 6, December 1996.

I. H. Witten, E. Frank, M. A. Hall, and C. J. Pal, Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, 2016.

UM Fayyad, G Piatetshy-Shapiro, P Smyth, and R Uthurusamy, Advances in Knowledge Discovery and Data Mining AAAI/MIT Press, 1996.

G. Piatetsky-Shapiro and W.J. Frawley, Knowledge Discovery in Databases, AAAI/MIT Press, 1991.

A. Silberschatz, M. Stonebraker, and J.D. Ullman, Database Research: Achievements and Opportunities into the 21st Century, Report, NSF Workshop Futuve of Database Systems Research, 1995.

G. D. Smith and S. Ebrahim, Data dredging, bias, or confounding, Bmj, vol. 325, no. 7378, pp. 1437-8, 2002.

Fayyad, Piatetsky-Shapiro, G. and Smyth, P. (1996), From data mining to knowledge discovery: an overview, Advances in Knowledge Discovery and Data Mining, MIT Press, Cambridge, MA.

Technology Forecast: 1997 (1997), Price Waterhouse World Technology Center, Menlo Park, CA.

Weiss, S.H. and Indurkhya, N. (1998), Predictive Data Mining: A Practical Guide, Morgan Kaufmann Publishers, San Francisco, CA.

P. Gundecha and H. Liu, Mining Social Media: A Brief Introduction. Tutorials in operations research, 2012.

J. Han and M. Kamber, Data Mining Concepts and Techniques, Morgan Kaufmann, 2016.

Rung-Ching Chen, Christine Dewi, Su-Wen Huang, and Rezzy Eko Caraka, Selecting Critical Features for Data Classification Based on Machine Learning Methods, Journal of Big Data, SpringerOpen, 2020.

M. J, Zaki and W. Meira Jr, Data Mining and Analysis-Fundamental Concepts and Algorithms, Cambridge University Press. New York, USA.

Mahmudah U, Suhartono, Fatimah S. A robust approach to analyzing the factors influencing quality education in Indonesia. New Educ Rev. 2017;49(3):77–90.

Cristobal Romero and Sebastian Ventura, Data mining in education. WIREs Data Mining Knowledge Discovery 2013, 3: 12–27.

Y. Lecun, C. Cortes, and C. J. C. Burges, The MNIST Database, Courant Institute, NYU, 2014.

Wang XD, Chen RC, Yan F, et al. Fast adaptive K-means subspace clustering for high-dimensional data, IEEE, 2019.

J. Han, M. Kamber and J. Pei, J Data Mining Concepts and Techniques (3rd ed.) Chapter 8, Pp. 99 117. University of Illinois. Illinois, 2010.

David Williams, Xuejun Liao, Ya Xue, and Lawrence Carin, Incomplete-Data Classification using Logistic Regression, Proceedings of the 22nd International Conference on Machine Learning, Germany, 2005.

Nasios and Bors, Variational Expectation Maximization Training for Gaussian Networks, Proceedings of the IEEE Workshop on Neural Networks for Signal Processing, 2003.

Neal, Bayesian learning for neural networks, New York, Springer; 1996.

Ghahramani and Jordan, Supervised Learning from Incomplete Data via the EM Approach, Advances in Neural Information Processing Systems, CA, 1994.

Beal and Ghahramani, The variational Bayesian EM algorithm for incomplete data: application to scoring graphical model structures, Bayesian Statistics 7, 453-464, 2003.

Ripley, Pattern Recognition and Neural Networks, Cambridge, Cambridge University Press; 1996.

Duda, Hart and Stork, Pattern Classification, Wiley, New York, 2000.

Zan Yang and Dan Li, Application of Logistic Regression with Filter in Data Classification, IEEE, China, 2019.

Collins, Schapire, and Singer, Logistic Regression, AdaBoost and Bregman Distances, Machine Learning Journal, 2004.

Fletcher and Leyffer, Nonlinear Programming without a Penalty Function, Mathematical Programming, 2002.

Wächter and Biegler, Line Search Filter Methods for Nonlinear Programming: Motivation and Global Convergence, SIAM J. Comput., 2005.

Fortunato, Gilberto, Marcelo, and Mário, Data Classification with Binary Response through the Boosting Algorithm and Logistic Regression, Elsevier, Brazil, 2016.

Cao et al., The Boosting: A New Idea of Building Models, Chemometrics and Intelligent Laboratory Systems, 2010.

Cai, Using Logitboost Classifier to Predict Protein Structural Classes, Journal of Theoretical Biology, 2006.

Widodo and Yang, Support Vector Machine in Machine Condition Monitoring and Fault Diagnosis, Mechanical Systems and Signal Processing, 2007.

Jihong Yan and Jay Lee, Degradation Assessment and Fault Modes Classification Using Logistic Regression, NSF I/UCRC Center for Intelligent Maintenance Systems, WI, 2005.

Caffo B., Developing Data Products in R, R Software, 2015.

Yang JY, Wang JS, Chen YP., Using acceleration measurements for activity recognition: an effective learning algorithm for constructing neural classifiers, Pattern Recogn Lett. 2008.

Jawad Raza, Jayantha Liyanage, Hassan Al Atat, and Jay Lee, A Comparative Study of Maintenance Data Classification Based on Neural Networks, Logistic Regression, and Support Vector Machines, Journal of Quality in Maintenance Engineering, 2010.

Kang and Naughton, On Schema Matching with Opaque Column Names and Data Values, SIGMOD, 2003.

Koeller and Rundensteiner, Discovery of High-Dimensional Inclusion Dependencies, ICDE, 2003.

Lopes, Petit, and Toumani, Discovering Interesting Inclusion Dependencies: Application to Logical Database Tuning, Information Systems, 2002.

Meihui, Marios, Beng, Cecilia, and Divesh, On Multi-Column Foreign Key Discovery, ACM, 2010.

Leopoldo Bertossi, Database Repairs and Consistent Query Answering: Origins and Further Developments, PODS, ACM, 2019.

Jef Wijsen, Foundations of Query Answering on Inconsistent Databases, SIGMOD, ACM, 2019.

Miika Hannula and Jef Wijsen, A Dichotomy in Consistent Query Answering for Primary Keys and Unary Foreign Keys, Proceedings of the 41st ACM Symposium on Principles of Database Systems, 2022.

Mozhgan, Sebastian, and Gillian, SQL Data Profiling of Foreign Keys, Springer, 2015.

Vladimir Zykin, Automatization of Foreign Keys Construction, Dynamics of Systems, Mechanisms and Machines, IEEE, 2016.

Alexandra, Oliver, Jana, Felix, and Ulf, A Machine Learning Approach to Foreign Key Discovery, 12th International Workshop on the Web and Databases, 2009.

Richard J. Roiger, Data Mining: A Tutorial-Based Primer, Second Edition, 2017.

Stephen Gardner, Building the Data Warehouse, ACM, 1998.

Rizzi, Abello, Lechtenborger, and Trujillo, Research in Data Warehouse Modeling and Design: Dead or Alive? DOLAP, ACM, USA, 2006.

Website: https://www.kaggle.com/datasets, Kaggle.

Downloads

Published

2024-05-08

How to Cite

Abu Alrub, M., & Shaout, A. (2024). Power DataMate Tool: Leveraging Logistic Regression Classification for Interactive Data Modeling. Transactions on Engineering and Computing Sciences, 12(2), 195–216. https://doi.org/10.14738/tecs.122.16892