research-article

Open access

Consistency-based service level agreements for cloud storage

Authors:

Douglas B. Terry,

Vijayan Prabhakaran,

Ramakrishna Kotla,

Mahesh Balakrishnan,

Marcos K. Aguilera,

Hussam Abu-LibdehAuthors Info & Claims

SOSP '13: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

Pages 309 - 324

https://doi.org/10.1145/2517349.2522731

Published: 03 November 2013 Publication History

Abstract

Choosing a cloud storage system and specific operations for reading and writing data requires developers to make decisions that trade off consistency for availability and performance. Applications may be locked into a choice that is not ideal for all clients and changing conditions. Pileus is a replicated key-value store that allows applications to declare their consistency and latency priorities via consistency-based service level agreements (SLAs). It dynamically selects which servers to access in order to deliver the best service given the current configuration and system conditions. In application-specific SLAs, developers can request both strong and eventual consistency as well as intermediate guarantees such as read-my-writes. Evaluations running on a worldwide test bed with geo-replicated data show that the system adapts to varying client-server latencies to provide service that matches or exceeds the best static consistency choice and server selection scheme.

Supplementary Material

MP4 File (d2-07-douglas-terry.mp4)

Download
1299.98 MB

References

[1]

S. Agarwal, J. Dunagan, N. Jain, S. Saroiu, A. Wolman, and H. Bhogan. Volley: Automated data placement for geo-distributed cloud services. Proceedings USENIX Symposium on Networked Systems Design and Implementation (NSDI), April 2010.

Digital Library

[2]

M. K. Aguilera, A. Merchant, M. Shah, A. Veitch, and C. Karamanolis. Sinfonia: A new paradigm for building scalable distributed systems. ACM Transactions on Computer Systems 27 (3), November 2009.

Digital Library

[3]

R. Alonso, D. Barbara, and H. Garcia-Molina. Data caching issues in an information retrieval system. ACM Transactions on Database Systems 15(3):359--384, September 1990.

Digital Library

[4]

Amazon Web Services. Amazon DynamoDB Pricing. http://aws.amazon.com/dynamodb/pricing/

[5]

Amazon Web Services. Amazon SimpleDB. http://aws.amazon.com/simpledb/

[6]

E. Anderson, X. Li, M. Shah, J. Tucek, and J. Wylie. What consistency does your key-value store actually provide? Proceedings USENIX Workshop on Hot Topics in Systems Dependability, 2010.

Digital Library

[7]

M. Armbrust, A. Fox, D. A. Patterson, N. Lanham, B. Trushkowsky, J. Trutna, and H. Oh. SCADS: Scale-independent storage for social computing applications. Proceedings Conference on Innovative Data Systems Research (CIDR), January 2009.

[8]

J. Baker, C. Bond, J. C. Corbett, JJ Furman, A. Khorlin, J. Larson, J.-M. Leon, Y. Li, A. Lloyd, and V. Yushprakh. Megastore: Providing scalable, highly available storage for interactive services. Proceedings Conference on Innovative Data Systems Research (CIDR), January 2011.

[9]

D. Barbara-Milla and H. Garcia-Molina. The demarcation protocol: A technique for maintaining constraints in distributed database systems. VLDB Journal 3(3):325--353, 1994.

Digital Library

[10]

N. Belaramani, M. Dahlin, L. Gao, A. Nayate, A. Venkataramani, P. Yalagandula and J. Zheng. PRACTI replication. Proceedings USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2006.

Digital Library

[11]

D. Bermbach and S. Tai. Eventual consistency: How soon is eventual? An evaluation of Amazon S3's consistency behavior. Proceedings Workshop on Middleware for Service Oriented Computing, December 2011.

Digital Library

[12]

E. Brewer. CAP twelve years later: How the "rules" have changed. IEEE Computer, February 2012.

Digital Library

[13]

N. Bonvin, T. G. Papaioannou, and K. Aberer. A self-organized, fault-tolerant and scalable replication scheme for cloud storage. Proceedings ACM Symposium on Cloud Computing (SoCC), June 2010.

Digital Library

[14]

B. Calder, J. Wang, A. Ogus, N. Nilakantan, A. Skjolsvold, S. McKelvie, Y. Xu, S. Srivastav, J. Wu, H. Simitci, J. Haridas, C. Uddaraju, H. Khatri, A. Edwards, V. Bedekar, S. Mainali, R. Abbasi, A. Agarwal, M. Fahim ul Haq, M. Ikram ul Haq, D. Bhardwaj, S. Dayanand, A. Adusumilli, M. McNett, S. Sankaran, K. Manivannan, and L. Rigas. Windows Azure Storage: A highly available cloud storage service with strong consistency. Proceedings ACM Symposium on Operating Systems Principles (SOSP), October 2011.

Digital Library

[15]

R. Cattell, Scalable SQL and NoSQL data stores, ACM SIGMOD Record 39(4), December 2010.

Digital Library

[16]

F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems 26(2), June 2008.

Digital Library

[17]

B. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. PNUTS: Yahoo!'s hosted data serving platform. Proceedings International Conference on Very Large Data Bases (VLDB), August 2008.

Digital Library

[18]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. Proceedings ACM Symposium on Cloud Computing (SoCC), June 2010.

Digital Library

[19]

J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, JJ Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L, Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's globally-distributed database. Proceedings USENIX Symposium on Operating System Design and Implementation (OSDI), October 2012.

Digital Library

[20]

G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. Proceedings ACM Symposium on Operating Systems Principles (SOSP), October 2007.

Digital Library

[21]

W. Golab, X. Li, and M. A. Shah. Analyzing consistency properties for fun and profit. Proceedings ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), June 2011.

Digital Library

[22]

Google. Read consistency & deadlines: more control of your datastore. Google App Engine Blog, March 29, 2010. http://googleappengine.blogspot.com/2010/03/read-consistency-deadlines-more-control.html

[23]

H. Guo, P.-Å. Larson, R. Ramakrishnan, and J. Goldstein. Relaxed currency and consistency: How to say "good enough" in SQL. Proceedings ACM International Conference on Management of Data (SIGMOD), June 2004.

Digital Library

[24]

J. Hamilton. The cost of latency. Perspectives Blog, October 31, 2009. http://perspectives.mvdirona.com/2009/10/31/TheCostOfLatency.aspx

[25]

S. Kadambi, J. Chen, B. F. Cooper, D. Lomax, R. Ramakrishnan, A. Silberstein, E. Tam, and H. Garcia-Molina. Where in the world is my data? Proceedings International Conference on Very Large Data Bases (VLDB), August 2011.

Digital Library

[26]

T. Kraska, M. Hentschel, G. Alonso, and D. Kossmann. Consistency rationing in the cloud: pay only when it matters. Proceedings International Conference on Very Large Data Bases (VLDB), August 2009.

Digital Library

[27]

A. Lakshman and P. Malik. Cassandra: a decentralized structured storage system. SIGOPS Operating Systems Review 44(2), April 2010.

Digital Library

[28]

L. Lamport. Time, clocks, and the ordering of events in a distributed system. Communications of the ACM 21(7), July 1978.

Digital Library

[29]

C. Li, D. Porto, A. Clement, J. Gehrke, N. Preguica, and R. Rodrigues. Making geo-replicated systems fast as possible, consistent when necessary. Proceedings USENIX Symposium on Operating System Design and Implementation (OSDI), October 2012.

Digital Library

[30]

W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Don't settle for eventual: Scalable causal consistency for wide-area storage with COPS. Proceedings ACM Symposium on Operating Systems Principles (SOSP), October 2011.

Digital Library

[31]

R. Minnear. Latency: The Achilles heel of cloud computing. Cloud Computing Journal, March 9, 2011.

[32]

Oracle. Oracle NoSQL Database. An Oracle White Paper, September 2011. http://www.oracle.com/technetwork/database/nosqldb/learnmore/nosql-database-498041.pdf

[33]

A. Phanishayee, D. G. Andersen, H. Pucha, A. Povzner, and W. Belluomini. Flex-KV: Enabling high-performance and flexible KV systems. Proceedings Workshop on Management of Big Data Systems, September 2012.

Digital Library

[34]

M. Serafini and F. Junqueira. Weak consistency as a last resort. Proceedings ACM Workshop on Large Scale Distributed Systems and Middleware (LADIS), July 2010.

Digital Library

[35]

A. E. Silberstein, R. Sears, W. Zhou, and B. F. Cooper. A batch of PNUTS: Experiences connecting cloud batch and serving systems. Proceedings International Conference on Management of Data (SIGMOD), June 2011.

Digital Library

[36]

D. Terry, A. Demers, K. Petersen, M. Spreitzer, M. Theimer, and B. Welch. Session guarantees for weakly consistent replicated data. Proceedings IEEE International Conference on Parallel and Distributed Information Systems, 1994.

Digital Library

[37]

D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conflicts in Bayou, a weakly connected replicated storage system. Proceedings ACM Symposium on Operating Systems Principles (SOSP), December 1995.

Digital Library

[38]

D. Terry, V. Prabhakaran, R. Kotla, M. Balakrishnan, and M. K. Aguilera. Transactions with consistency choices on geo-replicated cloud storage. Microsoft Technical Report MSR-TR-2013-82, September 2013.

[39]

D. Terry. Replicated data consistency explained through baseball, Microsoft Technical Report MSR-TR-2011-137, October 2011. To appear in Communications of the ACM, December 2013.

Digital Library

[40]

J. F. Van Der Zwet. Layers of latency: Cloud complexity and performance. Wired, September 18, 2012.

[41]

R. van Renesse and F. B. Schneider. Chain replication for supporting high throughput and availability. Proceedings USENIX Symposium on Operating System Design and Implementation (OSDI), December 2004.

Digital Library

[42]

W. Vogels. Eventually consistent. Communications of the ACM, January 2009.

Digital Library

[43]

W. Vogels. Choosing consistency. All Things Distributed, February 24, 2010. http://www.allthingsdistributed.com/2010/02/strong_consistency_simpledb.html

[44]

H. Wada, A. Fekete, L. Zhao, K. Lee, and A. Liu. Data consistency properties and the trade-offs in commercial cloud storages: the consumers' perspective. Proceedings Conference on Innovative Data Systems Research (CIDR), January 2011.

[45]

X. Wang, S. Yang, S. Wang, X. Niu, and J. Xu. An application-based adaptive replica consistency for cloud storage. Proceedings IEEE International Conference on Grid and Cloud Computing, November 2010.

Digital Library

[46]

H. Yu and A. Vahdat. Design and evaluation of a conit-based continuous consistency model for replicated services. ACM Transactions on Computer Systems 20(3):239--282, August 2002.

Digital Library

Cited By

(2024)Analysis of Cloud Computing and Cloud Storage in Mobile Forensics Using the DEMATEL MethodComputer Science, Engineering and Technology10.46632/cset/2/2/42:2(33-43)Online publication date: 13-Aug-2024
https://doi.org/10.46632/cset/2/2/4
Lawniczak LDistler TSchiavoni VEdinger JCao JJin Z(2024)Targeting Tail Latency in Replicated Systems with Proactive RejectionProceedings of the 25th International Middleware Conference10.1145/3652892.3700775(327-340)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3652892.3700775
Bang TDouglas CCrooks NHellerstein J(2024)SkyPIE: A Fast & Accurate Oracle for Object PlacementProceedings of the ACM on Management of Data10.1145/36393102:1(1-27)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639310
Show More Cited By

Index Terms

Consistency-based service level agreements for cloud storage

Recommendations

Strict Timed Causal Consistency as a Hybrid Consistency Model in the Cloud Environment
Abstract
Cloud computing is a model of distributed systems. This system allows users to access virtual resources including the processing power, storage, applications, etc. Storage as a Service (SaaS) is one of the cloud computing services. ...
Highlights
- Cloud storage systems provide the storage service for the end-users.
- Cloud ...
Rendezvous: Where Serverless Functions Find Consistency
WORDS '23: Proceedings of the 4th Workshop on Resource Disaggregation and Serverless

Function-as-a-Service has been notoriously difficult to compose and integrate, leaving developers to resort to third-party datastores and queues as means to share state between functions. Applying this architecture on a geo-replicated setting may ...
Response time-based resource allocation according to service level agreements in cloud computing

Cloud computing is a technology which offers various services as and when required by the user through various cloud providers. The scalable nature of cloud has made it to reach various domains and have a strong root in every organisation. The resource ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '13: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

November 2013

498 pages

ISBN:9781450323888

DOI:10.1145/2517349

General Chair:
Michael Kaminsky
Intel Labs
,
Program Chair:
Mike Dahlin
Google and UT Austin

Copyright © 2013 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2013

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SOSP '13

Sponsor:

SIGOPS

SOSP '13: ACM SIGOPS 24th Symposium on Operating Systems Principles

November 3 - 6, 2013

Pennsylvania, Farminton

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

180
Total Citations
View Citations
5,464
Total Downloads

Downloads (Last 12 months)558
Downloads (Last 6 weeks)82

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

(2024)Analysis of Cloud Computing and Cloud Storage in Mobile Forensics Using the DEMATEL MethodComputer Science, Engineering and Technology10.46632/cset/2/2/42:2(33-43)Online publication date: 13-Aug-2024
https://doi.org/10.46632/cset/2/2/4
Lawniczak LDistler TSchiavoni VEdinger JCao JJin Z(2024)Targeting Tail Latency in Replicated Systems with Proactive RejectionProceedings of the 25th International Middleware Conference10.1145/3652892.3700775(327-340)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3652892.3700775
Bang TDouglas CCrooks NHellerstein J(2024)SkyPIE: A Fast & Accurate Oracle for Object PlacementProceedings of the ACM on Management of Data10.1145/36393102:1(1-27)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639310
Wang BLiu SDong HWang XXu WZhang JZhong PZhang Y(2024)Bandle: Asynchronous State Machine Replication Made EfficientProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3650091(265-280)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3650091
Xu ZDong YLou JWang YFu Y(2024)Edge AI-driven neural network predictions for replica sync optimizationApplied Soft Computing10.1016/j.asoc.2024.112083(112083)Online publication date: Aug-2024
https://doi.org/10.1016/j.asoc.2024.112083
Prakash VFreitas LGarg LSingh P(2024)Using AI Planning to Automate Cloud InfrastructureArtificial Intelligence: Theory and Applications10.1007/978-981-99-8479-4_10(125-137)Online publication date: 3-Jan-2024
https://doi.org/10.1007/978-981-99-8479-4_10
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_7
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Caching in Forschung und IndustrieSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_5(91-140)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_5
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Systeme für skalierbares DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_4(61-90)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_4
Meng X(2023)Study on Artificial Intelligence (AI) Assisted English Linguistics Teaching SystemProceedings of the 2023 2nd International Conference on Educational Innovation and Multimedia Technology (EIMT 2023)10.2991/978-94-6463-192-0_67(511-520)Online publication date: 5-Jul-2023
https://doi.org/10.2991/978-94-6463-192-0_67
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten