research-article

Free access

Rhizoma: a runtime for self-deploying, self-managing overlays

Authors:

Adrian Schüpbach,

Andrew Baumann,

Timothy RoscoeAuthors Info & Claims

Middleware '09: Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware

Article No.: 10, Pages 1 - 20

Published: 30 November 2009 Publication History

Abstract

The trend towards cloud and utility computing infrastructures raises challenges not only for application development, but also for management: diverse resources, changing resource availability, and differing application requirements create a complex optimization problem. Most existing cloud applications are managed externally, and this separation can lead to increased response time to failures, and slower or less appropriate adaptation to resource availability and pricing changes.

In this paper, we explore a different approach more akin to P2P systems: we closely couple a decentralized management runtime ("Rhizoma") with the application itself. The application expresses its resource requirements to the runtime as a constrained optimization problem. Rhizoma then fuses multiple real-time sources of resource availability data, from which it decides to acquire or release resources (such as virtual machines), redeploying the system to continually maximize its utility.

Using PlanetLab as a challenging "proving ground" for cloud-based services, we present results showing Rhizoma's performance, overhead, and efficiency versus existing approaches, as well the system's ability to react to unexpected large-scale changes in resource availability.

References

[1]

R. Adams. PsEPR operational notes. http://www.psepr.org/operational.php, May 2008.

[2]

J. Albrecht, R. Braud, D. Dao, N. Topilski, C. Tuttle, A. C. Snoeren, and A. Vahdat. Remote control: distributed application configuration, management, and visualization with Plush. In LISA'07, pages 1--19, 2007.

Digital Library

[3]

Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.

[4]

Amazon Web Services. Amazon S3 availability event. http://status.aws.amazon.com/s3-20080720.html, July 2008.

[5]

K. R. Apt and M. G. Wallace. Constraint Logic Programming using ECLⁱPS^e . Cambridge University Press, 2007.

Digital Library

[6]

P. Brett, R. Knauerhase, M. Bowman, R. Adams, A. Nataraj, J. Sedayao, and M. Spindel. A shared global event propagation system to enable next generation distributed services. In WORLDS'04, Dec. 2004.

[7]

T. Delaet, P. Anderson, and W. Joosen. Managing real-world system configurations with constraints. In ICN'08, Apr. 2008.

Digital Library

[8]

J.-P. Deschrevel. The ANSA model for trading and federation. Architecture Report APM.1005.1, Architecture Projects Management Limited, July 1993.

[9]

R. Huebsch. PlanetLab application manager. http://appmanager.berkeley.intel-research.net/, Nov. 2005.

[10]

T. Isdal, T. Anderson, A. Krishnamurthy, and E. Lazowska. Planetary scale control plane. http://www.cs.washington.edu/research/networking/cplane/, Aug. 2007.

[11]

J. Liang, S. Y. Ko, I. Gupta, and K. Nahrstadt. MON: On-demand overlays for distributed system management. In WORLDS'05, pages 13--18, 2005.

Digital Library

[12]

D. Oppenheimer, J. Albrecht, D. Patterson, and A. Vahdat. Distributed resource discovery on PlanetLab with SWORD. In WORLDS'04, Dec. 2004.

[13]

D. Oppenheimer, B. Chun, D. A. Patterson, A. Snoeren, and A. Vahdat. Service placement in a shared wide-area platform. In USENIX'06, June 2006.

Digital Library

[14]

K. Park and V. S. Pai. CoMon: a mostly-scalable monitoring system for PlanetLab. SIGOPS Oper. Syst. Rev., 40(1), 2006.

Digital Library

[15]

L. Peterson, D. Culler, T. Anderson, and T. Roscoe. A Blueprint for Introducing Disruptive Technology into the Internet. In HotNets-I, Oct. 2002.

Digital Library

[16]

R. Raman, M. Livny, and M. Solomon. Matchmaking: Distributed resource management for high throughput computing. In HPDC7, July 1998.

Digital Library

[17]

S. Rhea, D. Geels, T. Roscoe, and J. Kubiatowicz. Handling Churn in a DHT. In USENIX'04, June 2004.

Digital Library

[18]

R. Ricci, J. Duerig, P. Sanaga, D. Gebhardt, M. Hibler, K. Atkinson, J. Zhang, S. Kasera, and J. Lepreau. The Flexlab approach to realistic evaluation of networked systems. In NSDI'07, Apr. 2007.

Digital Library

[19]

J. F. Shoch and J. A. Hupp. The "worm" programs --- early experience with a distributed computation. Commun. ACM, 25(3):172--180, 1982.

Digital Library

[20]

K. Sycara, K. Decker, A. Pannu, M. Williamson, and D. Zeng. Distributed intelligent agents. IEEE Expert, Dec. 1996.

Digital Library

[21]

M. Wallace. Constraint programming. In J. Liebowitz, editor, The Handbook of Applied Expert Systems. CRC Press, Dec. 1997.

[22]

P. Yalagandula, P. Sharma, S. Banerjee, S. Basu, and S.-J. Lee. S3: a scalable sensing service for monitoring large networked systems. In INM'06, 2006.

Digital Library

[23]

Q. Yin, J. Cappos, A. Baumann, and T. Roscoe. Dependable self-hosting distributed systems using constraints. In HotDep'08, Dec. 2008.

Digital Library

Cited By

You GHwang SJain N(2013)UrsaACM Transactions on Storage10.1145/2435204.24352059:1(1-29)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1145/2435204.2435205
Wieder ABhatotia PPost ARodrigues RGribble SKatabi D(2012)Orchestrating the deployment of computations in the cloud with conductorProceedings of the 9th USENIX conference on Networked Systems Design and Implementation10.5555/2228298.2228335(27-27)Online publication date: 25-Apr-2012
https://dl.acm.org/doi/10.5555/2228298.2228335
Liu CRen LLoo BMao YBasu P(2012)CologneProceedings of the VLDB Endowment10.14778/2212351.22123575:8(752-763)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.14778/2212351.2212357
Show More Cited By

Index Terms

Rhizoma: a runtime for self-deploying, self-managing overlays

Recommendations

Rhizoma: a runtime for self-deploying, self-managing overlays
Middleware'09: Proceedings of the ACM/IFIP/USENIX 10th international conference on Middleware

The trend towards cloud and utility computing infrastructures raises challenges not only for application development, but also for management: diverse resources, changing resource availability, and differing application requirements create a complex ...
Consistent and automatic replica regeneration

Reducing management costs and improving the availability of large-scale distributed systems require automatic replica regeneration, that is, creating new replicas in response to replica failures. A major challenge to regeneration is maintaining ...
Quorum-based synchronization protocols for multimedia replicas

Multiple replicas of multimedia objects are distributed to peers in overlay networks. In quorum-based (QB) protocols, every replica may not be up-to-date and the up-to-date replica can be found in the version counter. Multimedia objects are ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Middleware '09: Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware

November 2009

497 pages

Conference Chair:
Roy H. Campbell
University of Illinois at Urbana-Champaign
,
Program Chairs:
Jean M. Bacon
University of Cambridge Computer Laboratory, UK
,
Brian F. Cooper
Yahoo! Research

Sponsors

Professional
USENIX Assoc: USENIX Assoc
IFIP

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 30 November 2009

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
204
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)5

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

You GHwang SJain N(2013)UrsaACM Transactions on Storage10.1145/2435204.24352059:1(1-29)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1145/2435204.2435205
Wieder ABhatotia PPost ARodrigues RGribble SKatabi D(2012)Orchestrating the deployment of computations in the cloud with conductorProceedings of the 9th USENIX conference on Networked Systems Design and Implementation10.5555/2228298.2228335(27-27)Online publication date: 25-Apr-2012
https://dl.acm.org/doi/10.5555/2228298.2228335
Liu CRen LLoo BMao YBasu P(2012)CologneProceedings of the VLDB Endowment10.14778/2212351.22123575:8(752-763)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.14778/2212351.2212357
Rai ABhagwan RGuha SCarey MHand S(2012)Generalized resource allocation for the cloudProceedings of the Third ACM Symposium on Cloud Computing10.1145/2391229.2391244(1-12)Online publication date: 14-Oct-2012
https://dl.acm.org/doi/10.1145/2391229.2391244
You GHwang SJain NFerreira PVeiga L(2011)Scalable load balancing in cluster storage systemsProceedings of the 12th International Middleware Conference10.5555/2414338.2414347(100-119)Online publication date: 12-Dec-2011
https://dl.acm.org/doi/10.5555/2414338.2414347
Yin QRoscoe TChen HZhang ZMoon SZhou Y(2011)A better way to negotiate for testbed resourcesProceedings of the Second Asia-Pacific Workshop on Systems10.1145/2103799.2103822(1-5)Online publication date: 11-Jul-2011
https://dl.acm.org/doi/10.1145/2103799.2103822
Liu CLoo BMao YChase JAbbadi A(2011)Declarative automated cloud resource orchestrationProceedings of the 2nd ACM Symposium on Cloud Computing10.1145/2038916.2038942(1-8)Online publication date: 26-Oct-2011
https://dl.acm.org/doi/10.1145/2038916.2038942
Chen XMao YMao ZVan der Merwe Jde Oliveira JOtt MGriffin TMedard M(2010)Declarative configuration management for complex and dynamic networksProceedings of the 6th International COnference10.1145/1921168.1921176(1-12)Online publication date: 30-Nov-2010
https://dl.acm.org/doi/10.1145/1921168.1921176
Wieder ABhatotia PPost ARodrigues RChockler GVigfusson YAguilera MShapiro M(2010)ConductorProceedings of the 4th International Workshop on Large Scale Distributed Systems and Middleware10.1145/1859184.1859197(44-48)Online publication date: 28-Jul-2010
https://dl.acm.org/doi/10.1145/1859184.1859197

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents