Digital Transformation: From Data Analytics to Customer Solutions. A Framework of Types, Techniques and Tools

Michail Angelopoulos; Yannis Pollalis

doi:10.14738/abr.96.10291

Authors

Michail Angelopoulos University of Piraeus
Yannis Pollalis Department of Economics, University of Piraeus, Greece

DOI:

https://doi.org/10.14738/abr.96.10291

Keywords:

Big Data, Machine Learning, Data Analytics, Data-driven solutions, Digital transformation

Abstract

It has become clear by now that the digital transformation has an obvious, lasting impact as much on the economic systems and commercial players as on the lives of individuals and on society at large. The decisions we make, our actions, even our existence in the digital world result in the production of massive amounts of data. These data can be integrated into large data analysis ecosystems and contribute positively to the revision of current business models and practices. Machine learning algorithms combined with the suitable tools, such as Python, turn raw data into useful information and lead to critical and correct decisions. The aim of this paper is to present a review of current popular and useful data analytics techniques and tools that lead to custom solutions for both customer and business. The most famous techniques based on Machine learning and visualization tools are represented here.

Author Biography

Michail Angelopoulos, University of Piraeus

Dr. Michail Angelopoulos since 2014 is Head of Planning & Financial Section at Research Center of Public Power Corporation SA (GR)The previous position in the Enterprise was Head of Research Section from 2008 – 2014. Prior was Chairman of the Board at Greek Observatory for the Information Society, and President at Prefecture Enterprise of Athens. Michail Angelopoulos was adjunct professor for operational research at Hellenic Air Force Academy, and for several years was teaching computer programming at General Mathematical Department of Technological Education Institute of Piraeus (GR). He holds a Degree in Mathematics and a MSc in Computer Science & Operational Research from University of Athens (GR). Additionally, he holds a MSc in Manufacturing: Management & Technology from The Open University (UK), a MBA from Hellenic Open University (GR), a Professional Certificate of Data Science for Executives from Columbia University (USA), and a Project Management Professional (PMP) Certificate from PMI Institute (USA). Michail Angelopoulos since 2020 is Doctor of Philosophy at University of Piraeus, Department of Economics (GR). Publications: 1. Angelopoulos, Michail and Pollalis, Yannis (2020). “Use of open data as a tool for successful lean management in public services: evidence from Greece”, Journal of Economics and Business (SPOUDAI), Vol.1-2 (8) 2. Grammatikis, P.R., Sarigiannidis, P., Iturbe, E., Rios. E., Sarigiannidis, A., Ioannidis, D., Machamint, V., Angelopoulos, M., Ramos F. (2020). “Secure and Private Smart Grid: The Spear Architecture”, Paper Conference, 6th IEEE International Conference on Network Softwarization (NetSoft2020), 2nd International Workshop on Cyber-Security Threats, Trust and Privacy Management in Software-defined and Virtualized Infrastructures (SecSoft), Ghent, Belgium. 3. Angelopoulos, Michail and Pollalis, Yannis (2019).”Critical Success Factors of Lean Management in Public Sector: Evidence from Greece”, International Journal of Management and Applied Science (IJMAS), Volume-5, Issue-10, pp12-18, DOI: IJMAS-IRAJ-DOI-16454 4. Angelopoulos, M.K., Kontakou, C.A. Pollalis, Y.A. (2019). “Lean management through digital transformation: Challenges and opportunities for the energy and public utilities industry”. Journal of Advanced Research in Management, Volume X, Winter, 2(20):57-69. DOI:10.14505/jarm.v10.2(20).01 5. Efstathopoulos, G, Grammatikis, P.R., Sarigiannidis, P., Argyriou, V., Sarigiannidis, A., Angelopoulos M. K. (2019). “Operational Data Based Intrusion Detection System for Smart Grid”, Paper Conference (Best Award), IEEE 24th International Workshop on Computer Aided Modeling and Design of Commmunication Links and Networks (CAMAD), Cyprus. Publisher:IEEE, DOI:10.1109/CAMAD.2019.8858503 6. Angelopoulos, Michail and Pollalis, Yannis (2017). “The Activity Based Costing application as a tool in supporting a Greek Public Company’s transition to a Lean Company”,Munich Personal RePEc Archive, Germany. 7. Angelopoulos, Michail and Pollalis, Yannis (2017).“Using KPIs and ABC costing system results during a Lean transformation to a Greek Public Company”, Munich Personal RePEc Archive, Germany. 8. Μ. P. Saltouros, M.Theologou, M. K. Angelopoulos, Ch. S. Ricoudis (1999), “An Efficient Evolutionary Algorithm for (Near)-Optimal Steiner Trees Calculation: an Approach to Routing of Multipoint Connections”, in Proceeding of 3rd International Conference on Computational Intelligence and Multimedia Applications (3rd ICCIMA ’99), New Delhi, India. 9. M. K Angelopoulos (1996). "Competitive European Programs The characteristics of a successful proposal", Conference Technology and Automation, Conference proceedings pp. 192-195, TEI PIRAEUS, 9-10 May 1996. Projects: Chairman of the Research Programs Committee of the Research & Standards Testing Center (June 2016 - today) Financial Signatory, Coordinator, Administrator and Member of the Research Teams of the approved European programs of PPC SA in the framework of the action Horizon 2020 of the European Union: 1. FTI Pilot-01- 2016 - Fast Track to Innovation Pilot An ultrasonic non-destructive testing system for detection and quantification of early stage subsurface creep damage in the thermal power generation industry – CREEPUT (PPC SA Budget: 866.722,50 €) 2. DS-07-2017 - Digital Security Focus Area Secure and PrivatE smart gRid– SPEAR (PPC SA Budget: 196.250,00 €) 3. SU-DS04-2018-2020 - Digital Security SDN–microgridre Silient Electrical eNergy SystEm-SDN-MicroSENSE ( PPC SA Budget: 258.750,00€) 4. Electrical Power System’s Shield against complex incidents and extensive cyber and privacy attacks - PHOENIX ( PPC SA Budget: 304.250,00 €) 5. LC-SC3-EC-4-2020 - Building A Low-Carbon, Climate Resilient Future: Secure, Clean And Efficient Energy bEhaVioral Insgihts anD Effective eNergy policy acTions – EVIDENT ( PPC SA Budget: 169.375,00 €) 6. ICT-56-2020 - Information and Communication Technologies nexT gEneRation sMart INterconnectEd ioT - TERMINET ( PPC SA Budget: 171.875,00€) Coordinator, Manager and Member of the Research Teams of the approved research programs of PPC SA in the framework of the action "RESEARCH - CREATE - INNOVATE" and the action "Bilateral Greek-German Cooperation" of the GSRT (NSRF): 1. Bioconversion of lignite power plant emissions to fuels and fine chemicals– BIOMEK ( PPC SA Budget: 490.010,00 €) 2. Efficient conversion of Greek Lignite and agricultural residues to electricity through catalyst-aided integrated gasification/SOFC and Direct Carbon Fuel Cell processes– LIGBIO GASOFC ( PPC SA Budget: 214.000,00 €) 3. Scale up of Electrochemically Promoted Catalytic Hydrogenation of CO2 for fuel production– CO2 TO FUELS ( PPC SA Budget: 270.000,00 €) 4. Injection locked (mutually coupled) Mid-infrared Interband Cascade Laser based gas sensor– ILLIAS (PPC SA Budget: 200.000,00 €) 5. Innovative protective coatings for energy and resource efficiency applications in power plants– CREATION ( PPC SA Budget: 40.000,00 €) 6. smArt mUlTi drOne insPection System for Critical EnergY Infrastructures– AUTOPSY (PPC SA Budget: 193.000,00 €)

References

Choi, Tsan-Ming & Wallace, Stein & Wang, Yulan. (2018). Big Data Analytics in Operations Management. Production and Operations Management. 27. 1868-1883. 10.1111/poms.12838.

Sahu, Neeraj; Deng, Hepu; and Mollah, Alemyehu. (2018). "Investigating The Critical Success Factors Of Digital Transformation For Improving Customer Experience".CONF-IRM 2018 Proceedings. 18. http://aisel.aisnet.org/confirm2018/18

Hess, T., et al. (2016). Options for Formulating a Digital Transformation Strategy. MIS Quarterly Executive 15 (2): 123-139.

Ward, J. and J. Peppard (2016). The Strategic Management of Information Systems: Building a Digital Strategy, John Wiley & Sons.

Reddy, S. and Werner Reinartz. (2017). “Digital Transformation and Value Creation: Sea Change Ahead.” NIM Marketing Intelligence Review 9.

Gerard George, Martine R. Haas, and Alex Pentland. (2014). Big Data and Management. AMJ, 57, 321–326, https://doi.org/10.5465/amj.2014.4002

Pappas, I.O., Mikalef, P., Giannakos, M.N. et al. Big data and business analytics ecosystems: paving the way towards digital transformation and sustainable societies. Inf Syst E-Bus Manage 16, 479–491 (2018). https://doi.org/10.1007/s10257-018-0377-z

Mayhew H, Saleh T, Williams S (2016) Making data analytics work for you—instead of the other way around. McKinsey Q Oct 4, pp 29–41

Ratra, Ritu & Gulia, Preeti. (2019). Big Data Tools and Techniques: A Roadmap for Predictive Analytics. 2249-8958. 10.35940/ijeat.B2360.129219.

Charlie Berger (2012) Big Data Analytics with Oracle Advanced Analytics In-Database Option.

Sindhuja Hari. (2020). What is Data Analytics? Hackr.io. Data Science. Data Analytics from https://hackr.io/blog/what-is-data-analytics.

Soltanpoor, Reza & Sellis, Timos. (2016). Prescriptive Analytics for Big Data. 9877. 245-256. 10.1007/978-3-319-46922-5_19.

Sivarajah, Uthayasankar & Kamal, Muhammad & Irani, Zahir & Weerakkody, Vishanth. (2016). Critical analysis of Big Data challenges and analytical methods. Journal of Business Research. 70. 10.1016/j.jbusres.2016.08.001.

Simran Kaur Arora. (2020). What is Data Analysis? Methods, Techniques & Tools. Hackr.io. Data Analytics from https://hackr.io/blog/what-is-data-analysis-methods-techniques-tools

Eckerson, W.W. Predictive analytics. (2007) Extending the value of your data warehousing investment. TDWI Best Pract. Report 1, 1–36

Bertsimas, D., Kallus, N.: From predictive to prescriptive analytics. arXiv preprint (2014). arXiv:1402.5481

Selvaraj, Poornima & Marudappa, Pushpalatha. (2020). A survey on various applications of prescriptive analytics. International Journal of Intelligent Networks. 1. 76-84. 10.1016/j.ijin.2020.07.001.

L'Heureux, Alexandra & Grolinger, Katarina & El Yamany, Hany & Capretz, Miriam. (2017). Machine Learning With Big Data: Challenges and Approaches. IEEE Access. PP. 1-1. 10.1109/ACCESS.2017.2696365.

NITA, STEFANIA. (2016). MACHINE LEARNING TECHNIQUES USED IN BIG DATA. Scientific Bulletin of Naval Academy. 19. 10.21279/1454-864X-16-I1-078.

Mahbobi, M. & Tiemann, T. K. (2015). Introductory Business Statistics with Interactive Spreadsheets. Victoria, B.C.: BCcampus.

Sreejesh S., Mohapatra S., Anusree M.R. (2014) Cluster Analysis. In: Business Research Methods. Springer, Cham. https://doi.org/10.1007/978-3-319-00539-3_10

Duncan Greaves (2019) Making Sense of Big Data Using Cluster Analysis, Impact, 2019:1, 25-29, DOI: 10.1080/2058802X.2019.1571299

Loh, Wei-Yin. (2011). Classification and Regression Trees. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. 1. 14 - 23. 10.1002/widm.8.

Rokach, Lior & Maimon, Oded. (2005). Decision Trees. 10.1007/0-387-25465-X_9.

Kustrin, Snezana & Beresford, Rosemary. (2000). Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research. Journal of pharmaceutical and biomedical analysis. 22.717-27. 10.1016/S0731-7085(99)00272-1.

Grossi, Enzo & Buscema, Massimo. (2008). Introduction to artificial neural networks. European journal of gastroenterology & hepatology. 19. 1046-54. 10.1097/MEG.0b013e3282f198a0.

García-Gonzalo, Esperanza & Fernández-Muñiz, Zulima & Garcia Nieto, Paulino Jose & Sánchez, Antonio & Menéndez, Marta. (2016). Hard-Rock Stability Analysis for Span Design in Entry-Type Excavations with Learning Classifiers. Materials. 9. 531. 10.3390/ma9070531.

Pradhan, Ashis. (2012). Support vector machine-A survey. IJETAE. 2.

Valentini, Giorgio & Masulli, Francesco. (2002). Ensembles of Learning Machines. Neural Nets WIRN Vietri-2002, Series Lecture Notes in Computer Sciences. 2486. 3-22. 10.1007/3-540-45808-5_1.

Ben Dickson. (2020). What is ensemble learning? TechTalks

Muzammil Khan and Sarwar Shah Khan. (2011). Data and Information Visualization Methods, and Interactive Mechanisms: A Survey. International Journal of Computer Applications 34(1):1-14.

Sadiku, Matthew & Shadare, Adebowale & Musa, Sarhan & Akujuobi, Cajetan & Perry, Roy. (2016). DATA VISUALIZATION. International Journal of Engineering Research and Advanced Technology (IJERAT). 12. 2454-6135.

Hogräfer, Marius & Heitzler, Magnus & Schulz, Hans-Jörg. (2020). The State of the Art in Map-Like Visualization. Computer Graphics Forum. 39. 647-674. 10.1111/cgf.14031.

Nétek, Rostislav & Pour, Tomáš & Slezakova, Renata. (2018). Implementation of Heat Maps in Geographical Information System – Exploratory Study on Traffic Accident Data. Open Geosciences. 10. 367-384. 10.1515/geo-2018-0029.

Lteef, Layla. (2011). Application of "Matrix Diagrams Tools" for Quality Improvement in High Education. 1. 172-191.

Islam, Mohaiminul. (2020). Data Analysis: Types, Process, Methods, Techniques and Tools. International Journal on Data Science and Technology. Vol. 6, No. 1, 2020. 10-15. 10.11648/j.ijdst.20200601.12.

R Programming language from https://www.r-project.org/

Bonthu, Sridevi & Bindu, Hima. (2018). Review of Leading Data Analytics Tools. International Journal of Engineering and Technology (UAE). 7. 10.14419/ijet.v7i3.31.18190.

Python Programming language from https://www.python.org/

Harshita Srivastava. (2020). Top 10 Data Science Python Libraries.

Acharjya, Debi & P, Kauser. (2016). A Survey on Big Data Analytics: Challenges, Open Research Issues and Tools. International Journal of Advanced Computer Science and Applications. 7. 511-518. 10.14569/IJACSA.2016.070267.

Apache Spark from https://spark.apache.org/

Tableau Software from https://www.tableau.com/

RapidMiner from https://rapidminer.com/why-rapidminer/

Power BI from https://powerbi.microsoft.com/en-us/

What is Power BI? IFI TECH from https://ifi.tech/2019/06/07/what-is-power-bi/