Professional Documents
Culture Documents
Big Data in Cloud Computing An Overview
Big Data in Cloud Computing An Overview
https://doi.org/10.22214/ijraset.2023.49619
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue IV Apr 2023- Available at www.ijraset.com
Abstract: Cloud computing is a potent tool for sophisticated and massive-scale computation. It removes the need for expensive
hardware, specialized space, and software maintenance. It has been noticed that cloud computing has resulted in a massive
increase in the volume of data, or big data. Managing massive amounts of data is a complex and time-consuming operation that
requires an extensive computer infrastructure for effective data processing and analysis. Many industries, including minor and
major organizations, healthcare, education, and many more, are attempting to harness the potential of big data. In healthcare,
for example, big data is used to reduce treatment costs, predict pandemic outbreaks, and prevent infections, among other things.
This article discusses comprehensive data processing strategies from system and application perspectives to offer an orderly
picture of the issues that application developers and database management system (DBMS) designers face while designing and
deploying internet-scale applications. While big data has various uses in various industries, it has challenges.
Keywords: Big Data, Cloud Computing, DBMS, Data Processing.
I. INTRODUCTION
Cloud computing has shown to be a practical paradigm for SOAP. This development has ushered in changes in the abstraction and
use of computer infrastructure. The flexibility, pay-as-you-go pricing model, cheap initial investment, and risk transferability of
cloud computing make it the go-to platform for establishing cost-effective business infrastructure. For several decades, distributed
databases have been the holy grail of scientific inquiry. However, as data patterns and applications evolve, a new form known as
key-value storage has emerged and is now extensively employed by many businesses. Hadoop, an open-source version of
MapReduce, is widely utilized in business and academia [1]. In terms of usability and efficiency, Hadoop is a game-changer. HDFS
has become a beneficial technology for managing and archiving large, complicated datasets. It is becoming easier for computers to
access and make sense of big data. Today is a data-driven world. They are everywhere these days due to the fantastic technological
advances of recent years [2]. The pace of digitization has accelerated, and the term "digital information societies" has entered
common parlance. Whereas just 1% of information created 20 or 30 years ago was digital, now more than 94% of information
arrives in digital form from a wide variety of digital sources. Large data sets that exceed the capacity of existing technologies are a
hallmark of the "big data" phenomenon, which represents the evolution of human cognition [3]. Fast, heterogeneous data calls for
novel processing forms to facilitate decision-making, insight discovery, and process optimization. We must be able to safely store,
handle, and share complex data on the cloud so that we can analyse the data and identify trends. Given the cloud's inherent
complexity, we believe that focusing on incremental improvements to cloud security is preferable to presenting comprehensive
approaches.
II. BIG DATA
Big data refers to the enormous, intricate, and varied databases that are challenging to handle and process using conventional data
processing techniques. Volume, Velocity, and Variety are the three Vs that define it. The enormous quantity of data produced by
numerous sources, including social media, sensors, and other digital devices, is referred to as volume. Velocity is the measure of
how quickly data must be handled in order to be used in real-time. Data that is diverse includes all kinds and forms, including
organized, semi-structured, and unstructured data. The difficulties of handling and studying these sizable files have given rise to big
data technologies like Hadoop, Spark, and NoSQL databases. [4]. These tools enable businesses to gather insightful data and make
data-driven choices in a variety of industries, including marketing, finance, and healthcare.
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 241
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue IV Apr 2023- Available at www.ijraset.com
3) Variety: Raw data, semi-structured data, and unprocessed data all contribute to the vastness and variety of available
information.
4) Velocity: Speed with which information is gathered, stored, and processed by an organisation; for example, the number of
social media postings or search queries received daily, hourly, or in any other time period.
5) Veracity: Executive confidence is typically influenced by the "truth" or accuracy of data and information assets.
Processing in Velocity may be done in two main ways: in a batch, or in a continuous stream. It is common practice to process data
in batches that have been saved for later use. Data handled in batches tend to be quite useful. As a result, their processing time will
increase. For large amounts of data, Hadoop MapReduce is the best framework available. This technique works well when
processing large volumes of data is more important than obtaining real-time analytics.
However, stream processing is fundamental for real-time data processing and analysis. With the use of stream processing, new
information may be examined as it comes. Rapid ingestion of this data into analytics tools enables rapid output of findings. The
ability to spot anomalies that point to fraud in real time makes this approach promising in a number of contexts. Furthermore, online
firms would profit from real-time processing since it would enable them to keep detailed records of consumer transactions and
provide real-time product recommendations [6].
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 242
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue IV Apr 2023- Available at www.ijraset.com
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 243
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue IV Apr 2023- Available at www.ijraset.com
VII. CONCLUSION
Big Data is not a new concept, but it has recently come to the forefront due to the daily production of vast quantities of data from
many sources. Our investigation revealed that big data is expanding rapidly, resulting in both advantages and concerns. Cloud
computing is the ideal method for storing, processing, and analysing Big Data. The capacity to store vast volumes of data in a
variety of formats and to analyse it at very high rates will provide data that can assist companies and educational institutions in their
rapid development. The article provided an overview of Big Data and Cloud Computing, including its basic concepts and
terminology, as well as the evolution of data management into cloud computing. As a bonus, it investigates the upsides and
downsides of combining big data with cloud computing. Data storage and processing power are significant perks of cloud
computing and extensive data integration; the cloud has access to a vast pool of resources and a variety of infrastructures that can
accommodate this integration in the most suitable manner possible. The environment can be set up and managed with minimal effort
to provide an excellent workspace for all extensive data requirements.
REFERENCES
[1] Neelay Jagani, Parthil Jagani, Suril Shah et al (2021) Big Data in Cloud Computing: A Literature Review. International Journal of Engineering Applied
Sciences & Technology 5(11):185-191
[2] Samir A. El-Seoud, Hosam F. El-Sofany, Mohamed Abdelfattah, Reham Mohamed et al (2017) Big Data and Cloud Computing: Trends and Challenges.
International Journal of Interactive Mobile Technologies 11(2):34
[3] Amanpreet Kaur Sandhu (2021) Big Data with Cloud Computing: Discussion and Challeneges. Big Data Mining and Analytics 5(1):32-40
[4] Venkatesh H, Shrivatsa D Perur, Nivedita Jalihal et al (2015) A Study On Use of Big Data in Cloud Computing Environment. International Journal of
Computer Science and Information Technologies 6(3):2076-2078
[5] Pedro Caldeira Neves, Bradley Schmerl, Jorge Bernardino, Javier Camara et al (2016) Big Data in Cloud Computing: Features and Issues. International
Conference on Internet of Things and Big Data 307-314
[6] T. Sri Harsha (2017) Big Data Analytics in Cloud Computing Environment. International Journal of Scientific & Engineering Research 8(8):393-398
[7] Ibrahim Abaker Targio Hashem, Ibrar Yaqoob, Nor Badrul Anuar, Salimah Mokhtar, Abdullah Gani, Samee Ullah khan et al (2015) The rise of “big data” on
cloud computing: Review and open research issues. Information Systems 47:98-115
[8] Subia Saif, Samar Wazir (2018) Performance Analysis of Big Data and Cloud Computing Techniques: A Survey. International Conference on Computational
Intelligence and Data Science 132:118-127
[9] Shahana PN (2022) Impact and Implications of Big Data Analytics in Cloud Computing Platforms. International Journal for Research in Applied Science and
Engineering Technology 10(5)
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 244
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue IV Apr 2023- Available at www.ijraset.com
[10] Md. Golam Morshed, Ling Yuan (2017) Big Data in Cloud Computing: An Analysis of Issues and Challenges. International Journal of Advanced Studies in
Computer Science and Engineering 6(4):7-11
[11] Hassan Sohail, Zeenia Zameer, Hafiz Farhan Ahmed, Usama Iqbal, Pir Amad Ali Shah et al (2017) Challenges and Opportunities in Big Data and Cloud
Computing. ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 175-181
[12] Chaowei Yang, Qunying Huang, Zhenlong Li, Kai Liu, Fei Hu et al (2017) Big Data and Cloud Computing: Innovation Opportunities and Challenges.
International Journal of Digital Earth 10(1):13-53
[13] Venkata Narasimha Inukollu, Sailaja Arsi, Srinivasa Rao Ravuri et al (2014) Security Issues Associated with Big Data in Cloud Computing. International
Journal of Network Security & its Applications 6(3):45-56
[14] Jinsong Zhang (2018) Applications and Challenges of Big Data and Cloud Computing in Power Industry. International Symposium on Communication
Engineering & Computer Science 86:119-122
[15] Manoj Muniswamaiah, Dr. Tilak Agerwala, Dr. Charles Tappert et al (2019) Challenges of Big Data Applications in Cloud Computing. CS&IT-CSCP:221-232
[16] P. Mandana Mohan, B. Murali Manohar (2021) Challenges in Big Data Analytics & Cloud Computing. International Journal of Business and Management
Research 9(2):156-161
[17] Bo Li (2022) Research Review of Cloud Computing Technology Based on Big Data. Conference on Image Processing , Electronics and Computers 198-201
[18] Blend Berisha, Endrit Meziu, Isak Shabani et al (2022) Big Data Analytics in Cloud Computing: An Overview. J Cloud Comput 11(1):24
[19] Jayaraj T, J. Abdul Samath (2020) Secure and Cost-Effective Big-Data Analysis in Cloud Computing. International Journal of Scientific & Technology
Research 9(2):3717-3720
[20] Mythreyee S, Poornima Purohit, Apoorva D.R , Harshitha R, Lathashree P.V et al (2017) A Study On Use of Big Data in Cloud Computing Environment.
International Journal of Advance Research , Ideas and Innovations in Technology 3(3):1312-1318
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 245