Implementation of Big Data Analytics and its Challenges in Digital Transformation Era: A Literature Review

Firsty Larastiyana Susanto, Agustin Maulani, Siti Nuran Nuri

Abstract


The reliance on technology to support various aspects of human life has become very relevant and significant. The steadily increasing volume of data (called big data) plays an important role in machine learning, Internet of Things (IoT) and other intelligence applications. The interaction between big data and operations in various aspects of human life is a concern, this systematic literature review provides a descriptive aspect of the literature review, the research results offer a comprehensive overview of existing big data implementations ranging from 2019 to 2023. Other than this, we discuss the general challenges for researchers in using various big data sources in different crises. This study, especially revealing the implementation and challenges of big data in general, is expected to provide a knowledge base for researchers to delve deeper and more specifically.


Article Metrics

Abstract: 189 Viewers PDF: 105 Viewers

Keywords


Big Data, Big Data Analytics, Implementation, Challenges, Systematic Literature Review

Full Text:

PDF


References


V. Mayer-Schönberger and K. Cukier, “Big data: A revolution that will transform how we live, work, and think,” Houghton Mifflin Harcourt, 2013.

T. H. Davenport and D. J. Patil, “Data scientist: The sexiest job of the 21st century,” Harv Bus Rev, vol. 90, no. 10, pp. 70–76, 2012.

J. Manyika et al., “Big data: The next frontier for innovation, competition, and productivity,” McKinsey Global Institute, 2011.

M. Chen, S. Mao, and Y. Liu, “Big data: Related technologies, challenges and future prospects,” Springerplus, vol. 5, no. 1, pp. 1–16, 2016.

U. Sivarajah, “Critical analysis of Big Data challenges and analytical methods,” J Bus Res, vol. 70, pp. 263–286, 2017.

E. Dumbill, “Making Sense of Big Data,” Big Data Now 1, pp. 1–19, 2012.

S. Kudyba and M. Warren, “Big Data, Big Analytics: Emerging Business Intelligence and Analytic Trends for Today’s Businesses,” Routledge, 2013.

E. Turban, R. Sharda, D. Delen, and D. King, “Business Intelligence and Analytics: Systems for Decision Support (10th ed.),” Pearson, 2017.

K. C. Laudon and J. P. Laudon, “Management information systems: Managing the digital firm (14th ed.),” Pearson, 2017.

S. Wang, “Applications, challenges and prospects of big data technologies,” Big Data Research 2.2, no. 59–64, 2015.

F. Provost and T. Fawcett, “Data science for business: What you need to know about data mining and data-analytic thinking,” O’Reilly Media, Inc, 2013.

J. Shen, “Discussion on the Implementation Path of Innovation and Entrepreneurship among College Students in the Context of Big Data,” Journal of Contemporary Educational Research, vol. 4, no. 3, pp. 1–5, 2020, doi: 10.26689/jcer.v4i3.1110.

A. I. Kabir, R. Karim, M. I. Hossain, and S. Newaz, “Prospects and Challenges of Using Big Data in Healthcare Sector of Bangladesh: Focus on the reformation of the healthcare system,” ResearchGate, vol. 4, no. 1, pp. 1–16, 2019, [Online]. Available: https://www.researchgate.net/publication/324719555_Prospects_and_Challenges_of_Using_Big_Data_in_Healthcare_Sector_of_Bangladesh_Focus_on_the_reformation_of_the_healthcare_system%250Ahttp://files/1323/Prospects and Challenges of Using Big Data in Heal.pdf

A. A. Albina, “Implementation of Big Data Analytics Model in SMEs to Enhance Productivity in Post Covid Era,” Int J Innov Sci Res Technol, vol. 7, no. 9, pp. 1238–1245, 2022.

D. Gupta and R. Rani, “A study of big data evolution and research challenges,” J Inf Sci, vol. 45, no. 3, pp. 322–340, 2019, doi: 10.1177/0165551518789880.

N. Sandu, E. Gide, and S. Karim, “A Comprehensive Analysis of Cloud based Big Data Challenges and Opportunities for SMEs in India,” Global Journal of Information Technology: Emerging Technologies, vol. 10, no. 1, pp. 35–44, 2020, doi: 10.18844/gjit.v%vi%i.4745.

S. Li, L. Wang, and S. Li, “The Realistic Dilemma and Implementation Countermeasures of the Integration of Industry and Education in the Big Data Era,” Academic Journal of Business & Management, vol. 3, no. 6, pp. 67–71, 2021, doi: 10.25236/ajbm.2021.030609.

C. Li, Y. Chen, and Y. Shang, “A review of industrial big data for decision making in intelligent manufacturing,” Engineering Science and Technology, an International Journal, vol. 29, p. 101021, 2022, doi: 10.1016/j.jestch.2021.06.001.

O. Y. Mohammed, H. I. Abed, and N. A. Sultan, “Design and Implementation of Machine Learning and Big Data Analytics models for Cloud Computing platforms,” International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 6, pp. 185–192, 2023.

L. W. K. Lim, “Implementation of Artificial Intelligence in Aquaculture and Fisheries: Deep Learning, Machine Vision, Big Data, Internet of Things, Robots and Beyond,” Journal of Computational and Cognitive Engineering, vol. 00, no. March, pp. 1–7, 2023, doi: 10.47852/bonviewjcce3202803.

S. Fauzan, C. Wardoyo, F. D. Candra, K. Mauludah, and Kurniawan, “Implementation Of Big Data In Quality Assurance Of Accounting Department At SMKN 1 Randudongkal,” International Journal Of Humanities Education and Social Sciences (IJHESS), vol. 2, no. 2, pp. 521–528, 2022, doi: 10.55227/ijhess.v2i2.267.

I. Widiasanti, A. Anggie, F. Zanuara, and D. F. Maulidina, “Implementation of Big Data in the Zoom and Google Classroom Applications as Online Learning Media,” Indonesian Journal of Education & Mathematical Science, vol. 4, no. 2, pp. 86–92, 2023, doi: 10.30596/ijems.v4i2.14828.

Y. Jianhao, “Design and Implementation of Bank Wind Control Anti-fraud Project Based on Big Data Technology,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Nov. 2019. doi: 10.1088/1742-6596/1345/2/022064.

Y. Xian, “Analysis of how to meet the challenges brought by the development of internet finance and the era of big data,” J Phys Conf Ser, vol. 1792, no. 1, pp. 1–7, 2021, doi: 10.1088/1742-6596/1792/1/012041.

F. Gao, W. Zhong, X. Chen, and G. Yin, “Design and Implementation of Scientific Research Data Platform Based on Psychiatric Big Data,” Journal of Network Computing and Applications, pp. 21–25, 2019, doi: 10.23977/jnca.2019.41004.

E. D. Madyatmadja, C. N. A. Adiba, D. J. M. Sembiring, D. Pristinella, and A. M. Putra, “The positive impact of implementation business intelligence and big data in hospitality and tourism sector,” International Journal of Emerging Technology and Advanced Engineering, vol. 11, no. 6, pp. 59–71, 2021, doi: 10.46338/ijetae0621_07.

S. Venkatraman, S. Parvin, W. Mansoor, and A. Gawanmeh, “Big data analytics and internet of things for personalised healthcare: opportunities and challenges,” International Journal of Electrical and Computer Engineering, vol. 13, no. 4, pp. 4306–4316, 2023, doi: 10.11591/ijece.v13i4.pp4306-4316.

A. Lutfi et al., “Drivers and impact of big data analytic adoption in the retail industry: A quantitative investigation applying structural equation modeling,” Journal of Retailing and Consumer Services, vol. 70, no. June 2022, p. 103129, 2023, doi: 10.1016/j.jretconser.2022.103129.

S. Kumari and P. Muthulakshmi, “Transformative Effects of Big Data on Advanced Data Analytics: Open Issues and Critical Challenges,” Journal of Computer Science, vol. 18, no. 6, pp. 463–479, 2022, doi: 10.3844/jcssp.2022.463.479.

C. A. Escobar, M. E. McGovern, and R. Morales-Menendez, “Quality 4.0: a review of big data challenges in manufacturing,” J Intell Manuf, vol. 32, no. 8, pp. 2319–2334, Dec. 2021, doi: 10.1007/s10845-021-01765-4.

Z. Zhuo and S. Zhang, “Research on the application of big data management in enterprise management decision-making and execution literature review,” in ACM International Conference Proceeding Series, Association for Computing Machinery, 2019, pp. 268–273. doi: 10.1145/3318299.3318388.

L. Zhao, R. Jing, and G. Yu, “Research on the implementation path of rural revitalization strategy based on computer big data and industrial revitalization,” J Phys Conf Ser, vol. 1648, no. 2, 2020, doi: 10.1088/1742-6596/1648/2/022165.

R. P. N. Budiarti, S. Sukaridhoto, U. Zuhdi, A. Rasyid, and A. I. Sonhaji, “Implementation of Big Data Information System Using Open-Source Metabase for Civil Registration and Vital Statistics Data Visualization in Surabaya,” International Journal on Informatics Visualization, vol. 7, no. 4, pp. 2358–2365, 2023, doi: 10.30630/joiv.7.4.1722.

G. Mahendra, H. R. Roopashree, and A. C. Yogeesh, “Analysis of the Big Data Methods, Challenges and Applications in Intelligent Transportation Systems,” International Journal of Advanced Trends in Computer Science and Engineering, vol. 9, no. 5, pp. 7478–7486, 2020, doi: 10.30534/ijatcse/2020/81952020.

H. Sivaraman, M. Manchanda, S. Jasola, K. Purohit, and A. Gupta, “A prodigal paradigm for the solution of issues and challenges which leads in Big data security,” Turkish Journal of Computer and Mathematics Education, vol. 12, no. 12, pp. 2818–2823, 2021, [Online]. Available: https://www.proquest.com/scholarly-journals/prodigal-paradigm-solution-issues-challenges/docview/2628343635/se-2%0Ahttps://media.proquest.com/media/hms/PFT/1/wElAM?_a=ChgyMDIzMDIwODA0NDUxMDM2ODoxOTE5MzMSBTkxMTAwGgpPTkVfU0VBUkNIIgwxODIuMi4zOC4xMzMqBzIwNDUw

C. C. Chang et al., “Applying Artificial Intelligence (AI) Techniques to Implement a Practical Smart Cage Aquaculture Management System,” J Med Biol Eng, vol. 41, no. 5, pp. 652–658, 2021, doi: 10.1007/s40846-021-00621-3.

E. Sabet, “Reviewing the Challenges of Big Data Use in Smart Industries,” International Journal of Innovation in Management, Economics and Social Sciences, vol. 1, no. 4, pp. 66–72, 2021, doi: 10.52547/ijimes.1.4.66.

M. Suhaib, “Analysis of Big Data: Challenges and Fundamentals in the Computing System,” International Journal of Emerging Technology and Innovative Engineering, vol. 5, no. 6, p. 462, 2019.

M. M. Ziezo, J. O. Osakwe, M. M. Ujakpa, and G. E. Iyawa, “Challenges of Implementing Big Data Technology in Higher Institutions,” Journal of Information Systems and Informatics, vol. 3, no. 3, pp. 376–391, 2021, doi: 10.51519/journalisi.v3i3.161.

H. M. Mourad, D. Kaur, and M. Aarif, “Challenges Faced by Big Data and Its Orientation in the Field of Business Marketing.,” International Journal of Mechanical and Production Engineering Research and Development (IJMPERD), vol. 10, no. 3, pp. 8091–8102, 2020.

I. Khalil, R. Young, C. Kim, and C. Seo, “Challenges and Opportunities of Big Data,” Journal of Platform Technology, vol. 8, no. 2, p. 3, 2020.

P. C. Mishra and P. K. Mishra, “Challenges and Opportunities of Big Data Analytics for Human Resource Management in Mining and Metal Industries,” Journal of Mines, Metals and Fuels, vol. 71, no. 10, pp. 1747–1753, 2023, doi: 10.18311/jmmf/2023/35858.

R. Alshamy and M. Ghurab, “A Review of Big Data in Network Intrusion Detection System : Challenges , International Journal of Computer Sciences and Engineering Open Access A Review of Big Data in Network Intrusion Detection System : Challenges , Approaches , Datasets , and Tools,” International Journal of Computer Sciences and Engineering, vol. 8, no. 7, pp. 62–75, 2020.

M. G. K. Sriram, “Edge Computing vs. Cloud Computing: An Overview of Big Data Challenges and Opportunities For Large Enterprises,” International Research Journal of Modernization in Engineering Technology and Science, vol. 04, no. 01, pp. 1331–1337, 2022, [Online]. Available: www.irjmets.com

L. Baloch et al., “A Review of Big Data Trends and Challenges in Healthcare,” International Journal of Technology, vol. 14, no. 6, pp. 1320–1333, 2023, doi: 10.14716/ijtech.v14i6.6643.

N. Kumar et al., “Harnessing the Power of Big Data: Challenges and Opportunities in Analytics,” Tuijin Jishu/Journal of Propulsion Technology, vol. 44, no. 2, 2023, doi: 10.52783/tjjpt.v44.i2.193.

I. N. I. Ahmed, L. Marziana, and R. B. M. Nor, “Review of Opportunities and Challenges Represented by Big Data For Fintech In Malaysia,” Journal of Information Systems and Digital Technologies, vol. 5, no. 2, pp. 194–209, 2023.

Zakria, R. Bhatti, and K. Ahmad, “Challenges In the Implementation of Big Data Analytics (BDA) In Medical Institute Libraries of Pakistan,” JIMLS, vol. 4, no. 1, pp. 81–98, 2021.

S. Anawar, N. F. Othman, S. R. Selamat, Z. Ayop, N. Harum, and F. A. Rahim, “Security and Privacy Challenges of Big Data Adoption: A Qualitative Study in Telecommunication Industry,” International Journal of Interactive Mobile Technologies, vol. 16, no. 19, pp. 81–97, 2022, doi: 10.3991/ijim.v16i19.32093.

M. Wasim, F. G. Hussain, A. Nasir, and M. U. Ashraf, “A Comparative Study of Parallel and Distributed Big Data programming models: Methodologies, Challenges and Future Directions,” Lahore Garrison University Research Journal of Computer Science and Information Technology, vol. 7, no. 3, pp. 48–66, Oct. 2023, doi: 10.54692/lgurjcsit.2023.073365.

E. Nazari, M. Afkanpour, and H. Tabesh, “Viewpoints of Students in Mashhad in,” 2019. [Online]. Available: https://jbe.tums.ac.ir/

F. Yaqoob and J. Thomas, “Data Governance in the Era of Big Data: Challenges and Solutions,” no. January 2022, 2022, doi: 10.5281/zenodo.8415833.

A. Asemi, A. Asemi, A. Ko, and A. Alibeigi, “An integrated model for evaluation of big data challenges and analytical methods in recommender systems,” J Big Data, vol. 9, no. 1, 2022, doi: 10.1186/s40537-022-00560-z.

S. Alseady, A. Baz, T. Alsubait, L. Alarabi, and H. Alhakami, “Towards Security Challenges to Internet-of-Things: Big Data, Networks, and Applications,” International Journal of Computer Science and Network Security, vol. 20, no. 11, pp. 131–141, 2020.

H. S. Obaid, “Review the challenges of using big data in the supply chain,” Journal of Data Analytics, vol. 1, no. 1, pp. 16–24, 2022, doi: 10.59615/jda.1.1.16.

P. Mangal, A. Rajesh, and D. R. Misra, “Big Data in Climate Change Research: opportunities and Challenges,” Proceedings of International Conference on Intelligent Engineering and Management, ICIEM 2020, no. June, pp. 321–326, 2020, doi: 10.1109/ICIEM48762.2020.9160174.


Refbacks

  • There are currently no refbacks.



Barcode

IJIIS: International Journal of Informatics and Information Systems

ISSN:2579-7069 (Online)
Organized by:Departement of Information System, Universitas Amikom Purwokerto, IndonesiaFaculty of Computing and Information Science, Ain Shams University, Cairo, Egypt
Website:www.ijiis.org
Email:husniteja@uinjkt.ac.id (publication issues)
  taqwa@amikompurwokerto.ac.id (managing editor)
  contact@ijiis.org (technical & paper handling issues)

 This work is licensed under a Creative Commons Attribution-ShareAlike 4.0