Abstract
Cloud computing and big data are complementary, forming a dialectical relationship. Cloud computing and the widespread use of internet application is the ultimate need of the hour. Though seen as full of promising opportunities, both the fields have their own challenges. Cloud computing is a trend in technology development, while big data is an inevitable phenomenon of the rapid development of a modern information society. Modern means like Cloud computing technologies are needed to solve big data problems. With the advent of new technologies in the field of data and computing, innumerable services are emerging on the net, generating huge volume of data. The data so generated is becoming too large and complex to be effectively processed by conventional means. How to store, manage, and create values from this huge ocean of big data has become an important research problem in today’s time. Presently, users are accessing multiple data storage platforms to accomplish their operational and analytical requirements. Efficient integration of different data sources, in the merger of the two technologies, i.e., Big Data and Cloud, poses considerable challenges. Data integration here plays a very important role for both commercial and scientific domains in order to combine data from different sources and provides users with a unified view of these data. Keeping in mind the 4 V’s of Big Data (volume, velocity, variety, and veracity), studying the challenges and opportunities coming in the way of efficient data integration is a key research direction for scientists. This paper will describe \(\bullet \) How cloud and big data technologies are converging to offer a cost-effective delivery model for cloud-based big data analytics. \(\bullet \) Big Data Challenges. \(\bullet \) Challenges in cloud computing. \(\bullet \) Challenges when big data moves to cloud.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
The cloud as an enabler for big data analytic, Intel IT Centre, Big data in the cloud (April 2015)
NESSI: Big data white paper (2012)
www.cloudtweaks.com/2012/08/top-five-challenges-of-cloud-computing/
Waggener, S.: Cloud computing: managing data in the cloud. EDUCAUSE Q. 33(3) (2010)
https://inews.berkeley.edu/articles/Oct-Nov2010/cloud-computing-EQ3
http://www.moorestephens.com/cloud_computing_benefits_challenges.aspx
Labrinidis, A., Jagadish, H.V.: Challenges and opportunities with big data. Proc VLDB Endow. 5(12), 2032–2033 (2012)
Sarkar, D., Nath, A.: Big data – a pilot study on scope and challenges. IJARCSMS 2(12) (2014). www.ijarcsms.com
http://www.qubole.com/resources/articles/big-data-cloud-database-computing
Big data science: myth and reality (2015)
White paper: hadoop and HDFS: next generation data management
https://www.linkedin.com/pulse/20140306073407-64875646-big-data-the-5-vs-everyone-must-know
Zheng, Z., Zhu, J., Lyu, M.R.: Service-generated big data and big data-as-a-service: an overview (2013)
Ali Ahmed, E.S., Saeed, R.A.: A survey of big data cloud computing security (2014). www.Academia.edu
Evans, M., Huynh, T., Evans, A., Huynh, T., Le, K., Singh, M.: Cloud storage (2011)
Rexha, B., Likaj, B., Lajqi, H.: Assuring security in private clouds using ownCloud (2012) www.ijacit.com
Meenaskhi, A.C.: An overview on cloud computing technology. Int. J. Adv. Comput. Inf. Technol. (2012)
Hurwitz, J., Bloor, R., Kaufman, M., Halper, F.: Comparing public, private, and hybrid cloud computing options. Cloud computing for dummies (2009)
Vineetha, V.: Performance monitoring in cloud (2012). http://www.infosys.com/engineering-services/features-pinions/Documents/cloud-performance-monitoring.pdf
Shivi, G., Narayanan, T.: A review on matching public, private, and hybrid cloud computing options. Int. J. Comput. Sci. Inf. Technol. Res. 2(2) (2014)
Hemlatha, S.M., Ganesh, S.: A brief survey on encryption schemes on cloud environments. Int. J. Comput. Org. Trends 3(9) (2013)
http://searchcloudcomputing.techtarget.com/definition/hybrid-cloud (2015)
http://www.computerweekly.com/feature/Big-data-storage-Hadoop-storage-basics
www.cloudera.com/content/cloudera/en/.../hdfs-and-mapreduce.html (2013)
Patil, A., Bagban, T.I.: Improved utilization of infrastructure of clouds by using upgraded functionalities. Int. J. Innov. Res. Adv. Eng. 1(7) (2014)
www.qubole.com/resources/articles/big-data-cloud-database-computing
Sharma, T.: Modelling cloud services for big data using hadoop. Int. J. Comput. Sci. Inf. Technol. 6(2) (2015)
www.hadoop.apache.org > Hadoop > Apache Hadoop Project Dist POM
Ye, X., Huang, M., Zhu, D., Xu, P.: A novel blocks placement strategy for hadoop. In: Conference IEEE/ACIS 11th International Conference on Computer and Information Science (2012)
Sharir, R.: Cloud database service: the difference between dbaas, daas and cloud storage - what’s the difference (2011). http://xeround.com/blog/2011/02/dbaas-vs-daas-vs-cloud-storage-difference
Lenzerini, M.: Data integration: a theoretical perspective. In: Proceedings of the 21st ACMSIGMOD-SIGACT-SIGART Symposium on Principles of database systems. ACM (2002)
Slack, E.: Storage infrastructures for big data workflows. Technical Report, Storage Switchland, LLC (2012)
Zheng, Z., Zhu, J., Lyu, M.R.: Service-generated big data and big data-as-a-service: an overview (2013)
http://www.cloudera.com/content/cloudera/en/products-and-services/cdh/hdfs-and-mapreduce.html
http://www.qubole.com/resources/articles/what-is-hadoop/#sthash.Cnsov1wL.dpuf
http://www.qubole.com/resources/articles/big-data-cloud-database-computing/#sthash.p8s4FGVu.dpuf
An enterprise architect’s guide to big data reference architecture overview oracle enterprise architecture white paper (2015)
http://www.qubole.com/resources/articles/big-data-cloud-database-computing/#sthash.p8s4FGVu.dpuf
Optimized cloud resource management and scheduling. Elsevier Inc (2015) http://dx.doi.org/10.1016/B978-0-12-801476-9.00002-1
Singh, D., Reddy, C.K.: A survey of platforms of big data analytics. J. Big Data (2014)
www.searchtelecom.techtarget.com > Cloud networks
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Singapore
About this paper
Cite this paper
Joshi, P. (2016). Big Data Gets Cloudy: Challenges and Opportunities. In: Singh, V., Srivastava, H., Venturino, E., Resch, M., Gupta, V. (eds) Modern Mathematical Methods and High Performance Computing in Science and Technology. Springer Proceedings in Mathematics & Statistics, vol 171. Springer, Singapore. https://doi.org/10.1007/978-981-10-1454-3_16
Download citation
DOI: https://doi.org/10.1007/978-981-10-1454-3_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-1453-6
Online ISBN: 978-981-10-1454-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)