research-article

Open access

Towards a Non-2PC Transaction Management in Distributed Database Systems

Authors:

Zhengkui WangAuthors Info & Claims

SIGMOD '16: Proceedings of the 2016 International Conference on Management of Data

Pages 1659 - 1674

https://doi.org/10.1145/2882903.2882923

Published: 26 June 2016 Publication History

Abstract

Shared-nothing architecture has been widely used in distributed databases to achieve good scalability. While it offers superior performance for local transactions, the overhead of processing distributed transactions can degrade the system performance significantly. The key contributor to the degradation is the expensive two-phase commit (2PC) protocol used to ensure atomic commitment of distributed transactions. In this paper, we propose a transaction management scheme called LEAP to avoid the 2PC protocol within distributed transaction processing. Instead of processing a distributed transaction across multiple nodes, LEAP converts the distributed transaction into a local transaction. This benefits the processing locality and facilitates adaptive data repartitioning when there is a change in data access pattern. Based on LEAP, we develop an online transaction processing (OLTP) system, L-Store, and compare it with the state-of-the-art distributed in-memory OLTP system, H-Store, which relies on the 2PC protocol for distributed transaction processing, and H^L-Store, a H-Store that has been modified to make use of LEAP. Results of an extensive experimental evaluation show that our LEAP-based engines are superior over H-Store by a wide margin, especially for workloads that exhibit locality-based data accesses.

References

[1]

Tpc-c benchmark. http://www.tpc.org/tpcc/.

[2]

A. Adya et al. Efficient optimistic concurrency control using loosely synchronized clocks. In Proc. of SIGMOD, 1995.

Digital Library

[3]

P. Bailis et al. Coordination avoidance in database systems. In Proc. of VLDB, 2015.

[4]

J. Baker et al. Megastore: Providing scalable, highly available storage for interactive services. In Proc. of CIDR, 2011.

[5]

Y. Cao et al. Es2: A cloud data storage system for supporting both oltp and olap. In Proc. of ICDE, 2011.

Digital Library

[6]

S. Chandrasekaran et al. Shared cache - the future of parallel databases. In Proc. of ICDE, 2003.

[7]

F. Chang et al. Bigtable: A distributed storage system for structured data. ACM Trans. on Computer Systems, 26(2):4:1--4:26, 2008.

Digital Library

[8]

B. F. Cooper et al. Benchmarking cloud serving systems with ycsb. In Proc. of SoCC, 2010.

Digital Library

[9]

J. C. Corbett et al. Spanner: Google's globally-distributed database. In Proc. of OSDI, 2012.

Digital Library

[10]

C. Curino et al. Schism: A workload-driven approach to database replication and partitioning. In Proc. of VLDB, 2010.

Digital Library

[11]

S. Das et al. G-store: A scalable data store for transactional multi key access in the cloud. In Proc. of SoCC, 2010.

Digital Library

[12]

S. Das et al. Elastras: An elastic, scalable, and self-managing transactional database for the cloud. ACM Trans. on Database Systems, 38(1):5:1--5:45, 2013.

Digital Library

[13]

G. DeCandia et al. Dynamo: Amazon's highly available key-value store. In Proc. of SOSP, 2007.

Digital Library

[14]

D. E. Difallah et al. Oltp-bench: An extensible testbed for benchmarking relational databases. In Proc. of VLDB, 2014.

[15]

A. J. Elmore et al. Zephyr: Live migration in shared nothing databases for elastic cloud platforms. In Proc. of SIGMOD, 2011.

Digital Library

[16]

A. J. Elmore et al. Squall: Fine-grained live reconfiguration for partitioned main memory databases. In Proc. of SIGMOD, 2015.

Digital Library

[17]

C. Hewitt et al. A universal modular actor formalism for artificial intelligence. In Proc. of IJCAI, 1973.

Digital Library

[18]

P. Hunt et al. Zookeeper: Wait-free coordination for internet-scale systems. In Proc. of USENIX ATC, 2010.

Digital Library

[19]

D. Jiang et al. epic: An extensible and scalable system for processing big data. In Proc. of VLDB, 2014.

Digital Library

[20]

E. P. Jones et al. Low overhead concurrency control for partitioned main memory databases. In Proc. of SIGMOD, 2010.

Digital Library

[21]

R. Kallman et al. H-store: A high-performance, distributed main memory transaction processing system. In Proc. of VLDB, 2008.

Digital Library

[22]

J. F. Kurose et al. Computer networking: a top-down approach. Pearson Education, 2012.

Digital Library

[23]

A. Lakshman et al. Cassandra: Structured storage system on a p2p network. In Proc. of PODC, 2009.

Digital Library

[24]

S. Loesing et al. On the design and scalability of distributed shared-data databases. In Proc. of SIGMOD, 2015.

Digital Library

[25]

A. Pavlo. On Scalable Transaction Execution in Partitioned Main Memory Database Management Systems. PhD thesis, Brown University, 2014.

[26]

A. Pavlo et al. Skew-aware automatic database partitioning in shared-nothing, parallel oltp systems. In Proc. of SIGMOD, 2012.

Digital Library

[27]

M. Stonebraker et al. The voltdb main memory dbms. IEEE Data Engineering Bulletin, 36(2):21--27, 2013.

[28]

R. Taft et al. E-store: Fine-grained elastic partitioning for distributed transaction processing systems. In Proc. of VLDB, 2015.

[29]

K.-L. Tan et al. In-memory databases: Challenges and opportunities from software and hardware perspectives. ACM SIGMOD Record, 44(2):35--40, 2015.

Digital Library

[30]

A. Thomson et al. Calvin: Fast distributed transactions for partitioned database systems. In Proc. of SIGMOD, 2012.

Digital Library

[31]

G. Weikum et al. Transactional Information Systems: Theory, Algorithms, and the Practice of Concurrency Control and Recovery. Elsevier, 2001.

Digital Library

[32]

C. Yao et al. Adaptive logging: Optimizing logging and recovery costs in distributed in-memory databases. In Proc. of SIGMOD, 2016.

Digital Library

[33]

H. Zhang et al. In-memory big data management and processing: A survey. IEEE Trans. on Knowledge and Data Engineering, 27(7):1920--1948, 2015.

Digital Library

Cited By

Zhang MHua YYang ZGavrilovska ATerry D(2024)MotorProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691981(801-819)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691981
Bashtovyi AFechan A(2024)Distributed Transactions in Microservice Architecture: Informed Decision-making StrategiesVìsnik Nacìonalʹnogo unìversitetu "Lʹvìvsʹka polìtehnìka". Serìâ Ìnformacìjnì sistemi ta merežì10.23939/sisn2024.15.44915(449-459)Online publication date: 15-Jul-2024
https://doi.org/10.23939/sisn2024.15.449
Weng SWang QQu LZhang RCai PQian WZhou A(2024)Lauca: A Workload Duplicator for Benchmarking Transactional Database PerformanceIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.336011636:7(3180-3194)Online publication date: Jul-2024
https://doi.org/10.1109/TKDE.2024.3360116
Show More Cited By

Index Terms

Towards a Non-2PC Transaction Management in Distributed Database Systems
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Distributed database transactions

Recommendations

The Exclusive-Writer Approach to Updating Replicated Files in Distributed Processing Systems

Consistency control protocols can be classified as either pessimistic or optimistic. Pessimistic protocols check for conflicting file accesses before a transaction references shared files; this prevents transaction restarts but adds intercomputer ...
Dynamic Transaction Routing in Distributed Database Systems

The authors investigate dynamic transaction routing strategies for locally distributed database systems in which the database is partitioned and distributed among multiple transaction-processing systems, and the incoming transactions are routed by a ...
Deterministic transaction execution in distributed database systems

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '16: Proceedings of the 2016 International Conference on Management of Data

June 2016

2300 pages

ISBN:9781450335317

DOI:10.1145/2882903

General Chairs:
Fatma Özcan
IBM Research, USA
,
Georgia Koutrika
HP Labs, USA
,
Program Chair:
Sam Madden
Massachusetts Institute of Technology, USA

Copyright © 2016 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation Singapore under its Campus for Research Excellence and Technological Enterprise (CREATE) programme
National Research Foundation, Prime Minister's Office, Singapore under its Competitive Research Programme

Conference

SIGMOD/PODS'16

Sponsor:

SIGMOD

SIGMOD/PODS'16: International Conference on Management of Data

June 26 - July 1, 2016

California, San Francisco, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
2,013
Total Downloads

Downloads (Last 12 months)257
Downloads (Last 6 weeks)26

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang MHua YYang ZGavrilovska ATerry D(2024)MotorProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691981(801-819)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691981
Bashtovyi AFechan A(2024)Distributed Transactions in Microservice Architecture: Informed Decision-making StrategiesVìsnik Nacìonalʹnogo unìversitetu "Lʹvìvsʹka polìtehnìka". Serìâ Ìnformacìjnì sistemi ta merežì10.23939/sisn2024.15.44915(449-459)Online publication date: 15-Jul-2024
https://doi.org/10.23939/sisn2024.15.449
Weng SWang QQu LZhang RCai PQian WZhou A(2024)Lauca: A Workload Duplicator for Benchmarking Transactional Database PerformanceIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.336011636:7(3180-3194)Online publication date: Jul-2024
https://doi.org/10.1109/TKDE.2024.3360116
Zheng QZhao ZLu WYao CChen YPan ADu X(2024)Lion: Minimizing Distributed Transactions Through Adaptive Replica Provision2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00161(2012-2025)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00161
Talaver OVakaliuk T(2023)Reliable distributed systems: review of modern approachesJournal of Edge Computing10.55056/jec.5862:1(84-101)Online publication date: 17-May-2023
https://doi.org/10.55056/jec.586
Mapa Mudiyanselage CPerera PGrandhi S(2023)A Blockchain-Based Model for the Prevention of Superannuation Fraud: A Study of Australian Super FundsApplied Sciences10.3390/app1317994913:17(9949)Online publication date: 3-Sep-2023
https://doi.org/10.3390/app13179949
Depoutovitch AChen CLarson PNg JLin SXiong GLee PBoctor ERen SWu LZhang YSun C(2023)Taurus MM: Bringing Multi-Master to the CloudProceedings of the VLDB Endowment10.14778/3611540.361154216:12(3488-3500)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.14778/3611540.3611542
Nguyen CMiller JAbadi D(2023)Detock: High Performance Multi-region Transactions at ScaleProceedings of the ACM on Management of Data10.1145/35892931:2(1-27)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.1145/3589293
Zhang MHua YZuo PLiu L(2023)Localized Validation Accelerates Distributed Transactions on Disaggregated Persistent MemoryACM Transactions on Storage10.1145/358201219:3(1-35)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3582012
Lai ZFan HZhou WMa ZPeng XLi FLo E(2023)Knock Out 2PC with Practicality Intact: a High-performance and General Distributed Transaction Protocol2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00179(2317-2331)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00179
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten