Nothing Special   »   [go: up one dir, main page]

Skip to main content

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 171))

  • 867 Accesses

Abstract

Cloud computing and big data are complementary, forming a dialectical relationship. Cloud computing and the widespread use of internet application is the ultimate need of the hour. Though seen as full of promising opportunities, both the fields have their own challenges. Cloud computing is a trend in technology development, while big data is an inevitable phenomenon of the rapid development of a modern information society. Modern means like Cloud computing technologies are needed to solve big data problems. With the advent of new technologies in the field of data and computing, innumerable services are emerging on the net, generating huge volume of data. The data so generated is becoming too large and complex to be effectively processed by conventional means. How to store, manage, and create values from this huge ocean of big data has become an important research problem in today’s time. Presently, users are accessing multiple data storage platforms to accomplish their operational and analytical requirements. Efficient integration of different data sources, in the merger of the two technologies, i.e., Big Data and Cloud, poses considerable challenges. Data integration here plays a very important role for both commercial and scientific domains in order to combine data from different sources and provides users with a unified view of these data. Keeping in mind the 4 V’s of Big Data (volume, velocity, variety, and veracity), studying the challenges and opportunities coming in the way of efficient data integration is a key research direction for scientists. This paper will describe \(\bullet \) How cloud and big data technologies are converging to offer a cost-effective delivery model for cloud-based big data analytics. \(\bullet \) Big Data Challenges. \(\bullet \) Challenges in cloud computing. \(\bullet \) Challenges when big data moves to cloud.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. The cloud as an enabler for big data analytic, Intel IT Centre, Big data in the cloud (April 2015)

    Google Scholar 

  2. https://www.oracle.com/big-data/index.html

  3. NESSI: Big data white paper (2012)

    Google Scholar 

  4. www.cloudtweaks.com/2012/08/top-five-challenges-of-cloud-computing/

  5. http://www.qubole.com/hadoop-as-a-service (2015)

  6. Waggener, S.: Cloud computing: managing data in the cloud. EDUCAUSE Q. 33(3) (2010)

    Google Scholar 

  7. https://inews.berkeley.edu/articles/Oct-Nov2010/cloud-computing-EQ3

  8. http://www.moorestephens.com/cloud_computing_benefits_challenges.aspx

  9. Labrinidis, A., Jagadish, H.V.: Challenges and opportunities with big data. Proc VLDB Endow. 5(12), 2032–2033 (2012)

    Google Scholar 

  10. Sarkar, D., Nath, A.: Big data – a pilot study on scope and challenges. IJARCSMS 2(12) (2014). www.ijarcsms.com

  11. http://www.qubole.com/resources/articles/big-data-cloud-database-computing

  12. http://mahout.apache.org/

  13. Big data science: myth and reality (2015)

    Google Scholar 

  14. White paper: hadoop and HDFS: next generation data management

    Google Scholar 

  15. http://www.webopedia.com/TERM/B/big_data.html

  16. http://www.jeffince.co.uk/big-data--analytics.html

  17. https://www.linkedin.com/pulse/20140306073407-64875646-big-data-the-5-vs-everyone-must-know

  18. Zheng, Z., Zhu, J., Lyu, M.R.: Service-generated big data and big data-as-a-service: an overview (2013)

    Google Scholar 

  19. Ali Ahmed, E.S., Saeed, R.A.: A survey of big data cloud computing security (2014). www.Academia.edu

  20. http://www.thbs.com/knowledge-zone/cloud-computing-overview

  21. Evans, M., Huynh, T., Evans, A., Huynh, T., Le, K., Singh, M.: Cloud storage (2011)

    Google Scholar 

  22. Rexha, B., Likaj, B., Lajqi, H.: Assuring security in private clouds using ownCloud (2012) www.ijacit.com

  23. Meenaskhi, A.C.: An overview on cloud computing technology. Int. J. Adv. Comput. Inf. Technol. (2012)

    Google Scholar 

  24. Hurwitz, J., Bloor, R., Kaufman, M., Halper, F.: Comparing public, private, and hybrid cloud computing options. Cloud computing for dummies (2009)

    Google Scholar 

  25. Vineetha, V.: Performance monitoring in cloud (2012). http://www.infosys.com/engineering-services/features-pinions/Documents/cloud-performance-monitoring.pdf

  26. http://www.brainypro.com/cloudComputing.html (2013)

  27. Shivi, G., Narayanan, T.: A review on matching public, private, and hybrid cloud computing options. Int. J. Comput. Sci. Inf. Technol. Res. 2(2) (2014)

    Google Scholar 

  28. Hemlatha, S.M., Ganesh, S.: A brief survey on encryption schemes on cloud environments. Int. J. Comput. Org. Trends 3(9) (2013)

    Google Scholar 

  29. http://searchcloudcomputing.techtarget.com/definition/hybrid-cloud (2015)

  30. http://www.computerweekly.com/feature/Big-data-storage-Hadoop-storage-basics

  31. www.cloudera.com/content/cloudera/en/.../hdfs-and-mapreduce.html (2013)

  32. Patil, A., Bagban, T.I.: Improved utilization of infrastructure of clouds by using upgraded functionalities. Int. J. Innov. Res. Adv. Eng. 1(7) (2014)

    Google Scholar 

  33. www.qubole.com/resources/articles/what-is-hadoop

  34. www.qubole.com/resources/articles/big-data-cloud-database-computing

  35. Sharma, T.: Modelling cloud services for big data using hadoop. Int. J. Comput. Sci. Inf. Technol. 6(2) (2015)

    Google Scholar 

  36. www.hadoop.apache.org > Hadoop > Apache Hadoop Project Dist POM

  37. Ye, X., Huang, M., Zhu, D., Xu, P.: A novel blocks placement strategy for hadoop. In: Conference IEEE/ACIS 11th International Conference on Computer and Information Science (2012)

    Google Scholar 

  38. Sharir, R.: Cloud database service: the difference between dbaas, daas and cloud storage - what’s the difference (2011). http://xeround.com/blog/2011/02/dbaas-vs-daas-vs-cloud-storage-difference

  39. Lenzerini, M.: Data integration: a theoretical perspective. In: Proceedings of the 21st ACMSIGMOD-SIGACT-SIGART Symposium on Principles of database systems. ACM (2002)

    Google Scholar 

  40. Slack, E.: Storage infrastructures for big data workflows. Technical Report, Storage Switchland, LLC (2012)

    Google Scholar 

  41. Zheng, Z., Zhu, J., Lyu, M.R.: Service-generated big data and big data-as-a-service: an overview (2013)

    Google Scholar 

  42. http://en.wikipedia.org/wiki/MapReduce

  43. http://www.cloudera.com/content/cloudera/en/products-and-services/cdh/hdfs-and-mapreduce.html

  44. http://www.qubole.com/resources/articles/what-is-hadoop/#sthash.Cnsov1wL.dpuf

  45. http://www.qubole.com/resources/articles/big-data-cloud-database-computing/#sthash.p8s4FGVu.dpuf

  46. An enterprise architect’s guide to big data reference architecture overview oracle enterprise architecture white paper (2015)

    Google Scholar 

  47. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html

  48. http://hadoop.apache.org/hdfs

  49. http://www.qubole.com/resources/articles/big-data-cloud-database-computing/#sthash.p8s4FGVu.dpuf

  50. Optimized cloud resource management and scheduling. Elsevier Inc (2015) http://dx.doi.org/10.1016/B978-0-12-801476-9.00002-1

  51. Singh, D., Reddy, C.K.: A survey of platforms of big data analytics. J. Big Data (2014)

    Google Scholar 

  52. www.searchtelecom.techtarget.com > Cloud networks

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pramila Joshi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Joshi, P. (2016). Big Data Gets Cloudy: Challenges and Opportunities. In: Singh, V., Srivastava, H., Venturino, E., Resch, M., Gupta, V. (eds) Modern Mathematical Methods and High Performance Computing in Science and Technology. Springer Proceedings in Mathematics & Statistics, vol 171. Springer, Singapore. https://doi.org/10.1007/978-981-10-1454-3_16

Download citation

Publish with us

Policies and ethics