research-article

Declarative automated cloud resource orchestration

Authors:

Yun MaoAuthors Info & Claims

SOCC '11: Proceedings of the 2nd ACM Symposium on Cloud Computing

Article No.: 26, Pages 1 - 8

https://doi.org/10.1145/2038916.2038942

Published: 26 October 2011 Publication History

Abstract

As cloud computing becomes widely deployed, one of the challenges faced involves the ability to orchestrate a highly complex set of subsystems (compute, storage, network resources) that span large geographic areas serving diverse clients. To ease this process, we present COPE (Cloud Orchestration Policy Engine), a distributed platform that allows cloud providers to perform declarative automated cloud resource orchestration. In COPE, cloud providers specify system-wide constraints and goals using COPElog, a declarative policy language geared towards specifying distributed constraint optimizations. COPE takes policy specifications and cloud system states as input and then optimizes compute, storage and network resource allocations within the cloud such that provider operational objectives and customer SLAs can be better met. We describe our proposed integration with a cloud orchestration platform, and present initial evaluation results that demonstrate the viability of COPE using production traces from a large hosting company in the US. We further discuss an orchestration scenario that involves geographically distributed data centers, and conclude with an ongoing status of our work.

References

[1]

Gecode constraint development environment. http://www.gecode.org/.

[2]

RapidNet. http://netdb.cis.upenn.edu/rapidnet/.

[3]

XSB Project. http://xsb.sourceforge.net/.

[4]

Agarwal, S., Dunagan, J., Jain, N., Saroiu, S., Wolman, A., and Bhogan, H. Volley: automated data placement for geo-distributed cloud services. In NSDI (2010).

Digital Library

[5]

Al-Fares, M., Radhakrishnan, S., Raghavan, B., Huang, N., and Vahdat, A. Hedera: dynamic flow scheduling for data center networks. In NSDI (2010).

Digital Library

[6]

Campbell, R., Gupta, I., Heath, M., Ko, S. Y., Kozuch, M., Kunze, M., Kwan, T., Lai, K., Lee, H. Y., Lyons, M., Milojicic, D., O'Hallaron, D., and Soh, Y. C. Open cirrus cloud computing testbed: federated data centers for open source systems and services research. In HotCloud (2009).

Digital Library

[7]

Chen, X., Mao, Y., Mao, Z. M., and Van der Merwe, J. Declarative Configuration Management for Complex and Dynamic Networks. In CoNEXT (2010).

Digital Library

[8]

Chen, X., Mao, Z. M., and Van der Merwe, J. ShadowNet: A Platform for Rapid and Safe Network Evolution. In Proc. USENIX ATC (2009).

Digital Library

[9]

Chun, B.-G., Ihm, S., Maniatis, P., Naik, M., and Patti, A. Clonecloud: Elastic execution between mobile device and cloud. In EuroSys (2011).

Digital Library

[10]

Curino, C., Jones, E., Madden, S., and Balakrishnan, H. Workload-aware database monitoring and consolidation. In SIGMOD (2011).

Digital Library

[11]

Das, T., Padala, P., Padmanabhan, V. N., Ramjee, R., and Shin, K. G. Litegreen: saving energy in networked desktops using virtualization. In USENIX ATC (2010).

Digital Library

[12]

Hajjat, M., Sun, X., Sung, Y.-W. E., Maltz, D., Rao, S., Sripanidkulchai, K., and Tawarmalani, M. Cloudward bound: planning for beneficial migration of enterprise applications to the cloud. In SIGCOMM (2010).

Digital Library

[13]

Henzinger, T. A., Singh, A. V., Singh, V., Wies, T., and Zufferey, D. FlexPRICE: Flexible provisioning of resources in a cloud environment. In IEEE Conference on Cloud Computing (2010).

Digital Library

[14]

Henzinger, T. A., Singh, A. V., Singh, V., Wies, T., and ZUFFEREY, D. A marketplace for cloud resources. In EMSOFT (2010).

Digital Library

[15]

Liu, C., Mao, Y., Chen, X., Fernandez, M. F., Loo, B. T., and der Merwe, K. V. Towards transactional cloud resource orchestration. In NSDI (poster and demo) (2011).

[16]

Liu, C., Mao, Y., Van der Merwe, J., and Fernandez, M. Cloud Resource Orchestration: A Data-Centric Approach. In CIDR (2011).

[17]

Loo, B. T., Condie, T., Garofalakis, M., Gay, D. E., Hellerstein, J. M., Maniatis, P., Ramakrishnan, R., Roscoe, T., and Stoica, I. Declarative Networking. In Communications of the ACM (CACM) (2009).

Digital Library

[18]

Mengmeng Liu, Nicholas Taylor, Wenchao Zhou, Zachary Ives, and Boon Thau Loo. Recursive Computation of Regions and Connectivity in Networks. In ICDE (2009).

Digital Library

[19]

Narain, S., Levin, G., Malik, S., and Kaul, V. Declarative infrastructure configuration synthesis and debugging. J. Netw. Syst. Manage. 16 (September 2008), 235--258.

Digital Library

[20]

Qian, H., and Medhi, D. Server operational cost optimization for cloud computing service providers over a time horizon. In HotICE (2011).

Digital Library

[21]

Sahai, A., Singhal, S., Machiraju, V., and Joshi, R. Automated policy-based resource construction in utility computing environments. In IEEE/IFIP Network Operations and Management Symposium (2004).

[22]

Van der Merwe, J., Ramakrishnan, K., Fairchild, M., Flavel, A., Houle, J., Lagar-Cavilla, H. A., and Mulligan, J. Towards a ubiquitous cloud computing infrastructure. In LANMAN (2010).

[23]

White, S. R., Hanson, J. E., Whalley, I., Chess, D. M., Segal, A., and Kephart, J. O. Autonomic computing: Architectural approach and prototype. Integr. Comput.-Aided Eng. 13 (April 2006), 173--188.

Digital Library

[24]

Wood, T., Gerber, A., Ramakrishnan, K., Shenoy, P., and der Merwe, J. V. The case for enterprise-ready virtual private clouds. In HotCloud (2009)

Digital Library

[25]

Wood, T., Shenoy, P., Venkataramani, A., and Yousif, M. Black-box and gray-box strategies for virtual machine migration. In NSDI (2007).

Digital Library

[26]

Yin, Q., Schuepbach, A., Cappos, J., Baumann, A., and Roscoe, T. Rhizoma: a runtime for self-deploying, self-managing overlays. In Proceedings of Middleware (2009).

Digital Library

[27]

Zhang, Z., Zhang, M., Greenberg, A., Hu, Y. C., Mahajan, R., and Christian, B. Optimizing cost and performance in online service provider networks. In NSDI (2010).

Digital Library

Cited By

Verma SPandey BKumar Gupta B(2023)Containerization and its Architectures: A StudyADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal10.14201/adcaij.2835111:4(395-409)Online publication date: 5-Jun-2023
https://doi.org/10.14201/adcaij.28351
Zhang YMing ZPeng XLiu JZhang L(2023)LBFF: Load-Balancing First Fit Algorithm for Tenant Placement ProblemICC 2023 - IEEE International Conference on Communications10.1109/ICC45041.2023.10279638(6261-6267)Online publication date: 28-May-2023
https://doi.org/10.1109/ICC45041.2023.10279638
Sokolowski DRoychoudhury ACadar CKim M(2022)Infrastructure as code for dynamic deploymentsProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3558912(1775-1779)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3540250.3558912
Show More Cited By

Index Terms

Declarative automated cloud resource orchestration

Recommendations

A Taxonomy and Survey of Cloud Resource Orchestration Techniques

Cloud services and applications prove indispensable amid today’s modern utility-based computing. The cloud has displayed a disruptive and growing impact on everyday computing tasks. However, facilitating the orchestration of cloud resources to build ...
Automated cloud resource orchestration
Optimal resource provisioning for cloud computing environment

The paper presents an efficient cloud resource provisioning approach. The Software as a Service (SaaS) provider leases resources from cloud providers and also leases software as services to SaaS users. The SaaS providers aim at minimizing the payment of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOCC '11: Proceedings of the 2nd ACM Symposium on Cloud Computing

October 2011

377 pages

ISBN:9781450309769

DOI:10.1145/2038916

Program Chairs:
Jeffrey S. Chase
Duke University
,
Amr El Abbadi
Univ of California, Santa Barbara

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SOCC '11

Sponsor:

SOCC '11: ACM Symposium on Cloud Computing in conjunction with SOSP 2011

October 26 - 28, 2011

Cascais, Portugal

Acceptance Rates

Overall Acceptance Rate 169 of 722 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
1,116
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)6

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Verma SPandey BKumar Gupta B(2023)Containerization and its Architectures: A StudyADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal10.14201/adcaij.2835111:4(395-409)Online publication date: 5-Jun-2023
https://doi.org/10.14201/adcaij.28351
Zhang YMing ZPeng XLiu JZhang L(2023)LBFF: Load-Balancing First Fit Algorithm for Tenant Placement ProblemICC 2023 - IEEE International Conference on Communications10.1109/ICC45041.2023.10279638(6261-6267)Online publication date: 28-May-2023
https://doi.org/10.1109/ICC45041.2023.10279638
Sokolowski DRoychoudhury ACadar CKim M(2022)Infrastructure as code for dynamic deploymentsProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3558912(1775-1779)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3540250.3558912
Lan FBiswas SGui BWu JWang A(2022)Design and Implementation of a Strong Representation System for Network Policies2022 International Conference on Computer Communications and Networks (ICCCN)10.1109/ICCCN54977.2022.9868871(1-10)Online publication date: Jul-2022
https://doi.org/10.1109/ICCCN54977.2022.9868871
Li KJi YLiu SYao HLi HYou SShao S(2021)ACEAWireless Communications & Mobile Computing10.1155/2021/66210942021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/6621094
Lan FGui BWang A(2021)FauréProceedings of the 20th ACM Workshop on Hot Topics in Networks10.1145/3484266.3487391(123-131)Online publication date: 10-Nov-2021
https://dl.acm.org/doi/10.1145/3484266.3487391
Gui BLan FWang A(2021)Flexible Routing with Policy ExchangeProceedings of the 5th Asia-Pacific Workshop on Networking10.1145/3469393.3469395(21-28)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3469393.3469395
Sokolowski DSpinellis DGousios GChechik MDi Penta M(2021)Deployment coordination for cross-functional DevOps teamsProceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3468264.3473101(1630-1634)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3468264.3473101
Sokolowski DWeisenburger PSalvaneschi GSpinellis DGousios GChechik MDi Penta M(2021)Automating serverless deployments for DevOps organizationsProceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3468264.3468575(57-69)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3468264.3468575
Cao LMerican ATootaghaj DAhmed FSharma PSaxena VDing AMortier R(2021)eCaaSProceedings of the 4th International Workshop on Edge Systems, Analytics and Networking10.1145/3434770.3459741(73-78)Online publication date: 26-Apr-2021
https://dl.acm.org/doi/10.1145/3434770.3459741
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents