research-article

Defragmenting the cloud using demand-based resource allocation

Authors:

Ganesha Shanmuganathan,

Peter VarmanAuthors Info & Claims

ACM SIGMETRICS Performance Evaluation Review, Volume 41, Issue 1

Pages 67 - 80

https://doi.org/10.1145/2494232.2465763

Published: 17 June 2013 Publication History

Abstract

Current public cloud offerings sell capacity in the form of pre-defined virtual machine (VM) configurations to their tenants. Typically this means that tenants must purchase individual VM configurations based on the peak demands of the applications, or be restricted to only scale-out applications that can share a pool of VMs. This diminishes the value proposition of moving to a public cloud as compared to server consolidation in a private virtualized datacenter, where one gets the benefits of statistical multiplexing between VMs belonging to the same or different applications. Ideally one would like to enable a cloud tenant to buy capacity in bulk and benefit from statistical multiplexing among its workloads. This requires the purchased capacity to be dynamically and transparently allocated among the tenant's VMs that may be running on different servers, even across datacenters. In this paper, we propose two novel algorithms called BPX and DBS that are able to provide the cloud customer with the abstraction of buying bulk capacity. These algorithms dynamically allocate the bulk capacity purchased by a customer between its VMs based on their individual demands and user-set importance. Our algorithms are highly scalable and are designed to work in a large-scale distributed environment. We implemented a prototype of BPX as part of VMware's management software and showed that BPX is able to closely mimic the behavior of a centralized allocator in a distributed manner.

References

[1]

Linux containers (LXC) overview document. http://lxc.sourceforge.net/lxc.html.

[2]

Solaris Resource Management. http://docs.sun.com/app/docs/doc/817-1592.

[3]

B. Agrawal, L. Spracklen, S. Satnur, and R.Bidarkar. Vmware view 5.0 performance and best practices. 2011. http://www.vmware.com/files/pdf/view/VMware-View-Performance-Study-Best-Practices-Technical-White-Paper.pdf.

[4]

D. Ardagna, M. Trubian, and L. Zhang. SLA based resource allocation policies in autonomic environments.J. Parallel Distrib. Comput., 67(3):259--270, 2007.

Digital Library

[5]

G. Banga, P. Druschel, and J. C. Mogul. Resource containers: a new facility for resource management in server systems. In OSDI '99.

Digital Library

[6]

G. Casale, N. Mi, L. Cherkasova, and E. Smirni. How to parameterize models with bursty workloads. SIGMETRICS Perform. Eval. Rev., 36(2):38--44, 2008.

Digital Library

[7]

L. Cherkasova and J. A. Rolia. R-opus: A composite framework for application performability and qos in shared resource pools. In DSN, pages 526--535, 2006.

Digital Library

[8]

D. Gmach, J. Rolia, and L. Cherkasova. Satisfying service level objectices in a self-managing resource pool. In SASO, 2009.

Digital Library

[9]

D. Gmach, J. Rolia, and L. Cherkasova. Selling t-shirts and time shares in the cloud. In CCGRID, pages 539--546, 2012.

Digital Library

[10]

D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, and A. Kemper. An integrated approach to resource pool management: Policies, efficiency and quality metrics. In DSN, pages 326--335, 2008.

[11]

D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper. Capacity management and demand prediction for next generation data centers. In ICWS, pages 43--50, 2007.

[12]

A. Gulati, A. Holler, M. Ji, G. Shanmuganathan, C. Waldspurger, and X. Zhu. VMware Distributed Resource Management: Design, Implementation, and Lessons Learned. In VMware Technical Journal, March 2012.

[13]

B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: a platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX conference on Networked systems design and implementation, NSDI'11, 2011.

Digital Library

[14]

X. Meng, C. Isci, J. O. Kephart, L. Zhang, E. Bouillet, and D. E. Pendarakis. Efficient resource provisioning in compute clouds via vm multiplexing. In ICAC, pages 11--20, 2010.

Digital Library

[15]

Microsoft, Inc. Microsoft Hyper-V Server. 2012. http://www.microsoft.com/en-us/server-cloud/hyper-v-server/default.aspx%.

[16]

Nebula, Inc. 2012. http://www.nebula.com/.

[17]

Nimbula, Inc. 2012. http://www.nimbula.com/.

[18]

D. Niu, C. Feng, and B. Li. Pricing cloud bandwidth reservations under demand uncertainty. In SIGMETRICS, pages 151--162, 2012.

Digital Library

[19]

L. Spracklen, B. Agrawal, R.Bidarkar, and H. Sivaraman. Comprehensive user experience monitoring. March 2011. VMware Technical Journal.

[20]

C. Stewart and K. Shen. Performance modeling and system management for multi-component online services. In NSDI, 2005.

Digital Library

[21]

J. Tan, P. Dube, X. Meng, and L. Zhang. Exploiting resource usage patterns for better utilization prediction. In ICDCS Workshops, pages 14--19, 2011.

Digital Library

[22]

Y. Tan, Y. Lu, and C. H. Xia. Provisioning for large scale cloud computing services. In SIGMETRICS, pages 407--408, 2012.

Digital Library

[23]

B. Urgaonkar, G. Pacifici, P. J. Shenoy, M. Spreitzer, and A. N. Tantawi. An analytical model for multi-tier internet services and its applications. In SIGMETRICS, pages 291--302, 2005.

Digital Library

[24]

B. Urgaonkar, A. L. Rosenberg, and P. J. Shenoy. Application placement on a cluster of servers. Int. J. Found. Comput. Sci., 18(5), 2007.

[25]

B. Urgaonkar, P. J. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In OSDI, 2002.

Digital Library

[26]

VMware Big Data team. 2012. http://www.vmware.com/hadoop/serengeti.html.

[27]

VMware, Inc. VMware vCloud Suite. 2012. http://www.vmware.com/products/datacenter-virtualization/vcloud-suite/o%verview.html.

[28]

C. A. Waldspurger. Memory Resource Management in VMware ESX Server. In USENIX OSDI '02.

Digital Library

[29]

H. Wang, K. Doshi, and P. Varman. Nested QoS: Adaptive burst decomposition for SLO guarantees in virtualized servers. Intel Technology Journal, 16:156--181, June 2012.

[30]

K. Wang, M. Lin, F. Ciucu, A. Wierman, and C. Lin. Characterizing the impact of the workload on the value of dynamic resizing in data centers. In SIGMETRICS, pages 405--406, 2012.

Digital Library

[31]

M. Wang, X. Meng, and L. Zhang. Consolidating virtual machines with dynamic bandwidth demand in data centers. In INFOCOM, 2011.

[32]

W. Wang, B. Li, and B. Liang. Towards optimal capacity segmentation with hybrid cloud pricing. In ICDCS, pages 425--434, 2012.

Digital Library

[33]

T. Wood, L. Cherkasova, K. M. Ozonat, and P. J. Shenoy. Profiling and modeling resource usage of virtualized applications. In Middleware, pages 366--387, 2008.

Digital Library

[34]

Q. Zhang, L. Cherkasova, G. Mathews, W. Greene, and E. Smirni. R-capriccio: A capacity planning and anomaly detection tool for enterprise services with live workloads. In Middleware, 2007.

Digital Library

Cited By

Alshamrani S(2018)An Efficient Allocation of Cloud Computing ResourcesProceedings of the 2018 Artificial Intelligence and Cloud Computing Conference10.1145/3299819.3299828(68-75)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.1145/3299819.3299828
Shi WZhang LWu CLi ZLau F(2014)An online auction framework for dynamic resource provisioning in cloud computingACM SIGMETRICS Performance Evaluation Review10.1145/2637364.259198042:1(71-83)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2637364.2591980
Shi WZhang LWu CLi ZLau FSanghavi SShakkottai SLelarge MSchroeder B(2014)An online auction framework for dynamic resource provisioning in cloud computingThe 2014 ACM international conference on Measurement and modeling of computer systems10.1145/2591971.2591980(71-83)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2591971.2591980
Show More Cited By

Index Terms

Defragmenting the cloud using demand-based resource allocation
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Modeling methodologies
2. General and reference
  1. Cross-computing tools and techniques
    1. Measurement
    2. Metrics

Recommendations

Defragmenting the cloud using demand-based resource allocation
SIGMETRICS '13: Proceedings of the ACM SIGMETRICS/international conference on Measurement and modeling of computer systems

Current public cloud offerings sell capacity in the form of pre-defined virtual machine (VM) configurations to their tenants. Typically this means that tenants must purchase individual VM configurations based on the peak demands of the applications, or ...
Prediction of resource contention in cloud using second order Markov model
Abstract
The performance of applications running on the cloud entirely depends on two factors, namely, network availability and resource management. Resource contention occurs when request for resources to a host exceeds the availability of the resources ...
Who Is Your Neighbor: Net I/O Performance Interference in Virtualized Clouds

User-perceived performance continues to be the most important QoS indicator in cloud-based data centers today. Effective allocation of virtual machines (VMs) to handle both CPU intensive and I/O intensive workloads is a crucial performance management ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGMETRICS Performance Evaluation Review

ACM SIGMETRICS Performance Evaluation Review Volume 41, Issue 1

Performance evaluation review

June 2013

385 pages

ISSN:0163-5999

DOI:10.1145/2494232

Issue’s Table of Contents

SIGMETRICS '13: Proceedings of the ACM SIGMETRICS/international conference on Measurement and modeling of computer systems
June 2013
406 pages
ISBN:9781450319003
DOI:10.1145/2465529
General Chair:
Mor Harchol-Balter
Carnegie Mellon University, USA
,
Program Chairs:
John Douceur
Microsoft Research, USA
,
Jun Xu
Georgia Institute of Technology, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2013

Published in SIGMETRICS Volume 41, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
669
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alshamrani S(2018)An Efficient Allocation of Cloud Computing ResourcesProceedings of the 2018 Artificial Intelligence and Cloud Computing Conference10.1145/3299819.3299828(68-75)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.1145/3299819.3299828
Shi WZhang LWu CLi ZLau F(2014)An online auction framework for dynamic resource provisioning in cloud computingACM SIGMETRICS Performance Evaluation Review10.1145/2637364.259198042:1(71-83)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2637364.2591980
Shi WZhang LWu CLi ZLau FSanghavi SShakkottai SLelarge MSchroeder B(2014)An online auction framework for dynamic resource provisioning in cloud computingThe 2014 ACM international conference on Measurement and modeling of computer systems10.1145/2591971.2591980(71-83)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2591971.2591980
Shi WWu CLi Z(2018)A Shapley-Value Mechanism for Bandwidth On Demand between DatacentersIEEE Transactions on Cloud Computing10.1109/TCC.2015.24814326:1(19-32)Online publication date: 1-Jan-2018
https://doi.org/10.1109/TCC.2015.2481432
Vidyasagar LPal DKhethavath P(2018)Optimized Resource Allocation and Load Balancing in Distributed Cloud using Graph Theory2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI)10.1109/ICACCI.2018.8554929(2054-2058)Online publication date: Sep-2018
https://doi.org/10.1109/ICACCI.2018.8554929
Guo YRao JJiang CZhou X(2017)Moving Hadoop into the Cloud with Flexible Slot Management and Speculative ExecutionIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.258764128:3(798-812)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2587641
Liu HHe B(2016)F2CIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.249976927:9(2589-2602)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2499769
Shi WZhang LWu CLi ZLau FWeijie Shi Linquan Zhang Chuan Wu Zongpeng Li Lau F(2016)An Online Auction Framework for Dynamic Resource Provisioning in Cloud ComputingIEEE/ACM Transactions on Networking10.1109/TNET.2015.244465724:4(2060-2073)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1109/TNET.2015.2444657
Pillai PRao S(2016)Resource Allocation in Cloud Computing Using the Uncertainty Principle of Game TheoryIEEE Systems Journal10.1109/JSYST.2014.231486110:2(637-648)Online publication date: Jun-2016
https://doi.org/10.1109/JSYST.2014.2314861
Khan MVarman P(2016)Heterogeneous Resource Allocation in Shared Datacenters2016 45th International Conference on Parallel Processing Workshops (ICPPW)10.1109/ICPPW.2016.58(365-374)Online publication date: Aug-2016
https://doi.org/10.1109/ICPPW.2016.58
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents