Article

Free access

Experience with transactions in QuickSilver

Authors:

Jim WylieAuthors Info & Claims

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

Pages 239 - 253

https://doi.org/10.1145/121132.121171

Published: 01 September 1991 Publication History

Abstract

All programs in the QuickSilver distributed system behave atomically with respect to their updates to permanent data. Operating system support for transactions provides the framework required to support this, as well as a mechanism that unifies reclamation of resources after failures or normal process termination. This paper evaluates the use of transactions for these purposes in a general purpose operating system and presents some of the lessons learned from our experience with a complete running system based on transactions. Examples of how transactions are used in QuickSilver and measurements of their use demonstrate that the transaction mechanism provides an efficient and powerful means for solving many of the problems introduced by operating system extensibility and distribution.

References

[1]

M. M Astrahan, M. W. Blasgen, D. D. Chamberlin, K. P. Eswaran, J. N. Gray, P. P. Griffiths, W. F. King, R. A. Lorie, P. R. McJones, J. W. Mehl, G. R. Putzolu, I. L. Traiger, B. W. Wade, and V. Watson. System R: Relational approach to database management. A CM Transactions on Database Systems, 1(2):97-137, June 1976.

Digital Library

[2]

Luis-Felipe Cabrera, John McPherson, Peter Schwarz, and Jim Wyllie. A comparison of two log-based implementations of atomicity. In preparation, 1991.

[3]

Luis-Felipe Cabrera and Jim Wyllie. QuickSilver distributed file services: an architecture for horizontal growth, in Proceedings of the ~nd IEEE conference on computer workstations, Santa Clara, CA, March 1988.

[4]

David R. Cheriton. The V kernel: a software base for distributed systems. IEEE Software, 1(2):19- 42, April 1984.

Digital Library

[5]

Jeffrey L. Eppinger, Lilly Mummert, and Alfred Z. Spector, editors. Camelot and Avalon: A Distributed Transaction Facility. Morgan Kauffmann, 1991.

Digital Library

[6]

J. N. Gray, R. A. Lorie, G. R. Putzolu, and I. L. Traiger. Granularity of locks and degrees of consistency in a shared data base. In G. M. Nijssen, editor, Modelling in Data Base Management Systems, pages 365-394. North Holland Publishing Company, 1976.

[7]

Jim Gray, Paul McJones, Mike Blasgen, Bruce Lindsay, Raymond Lorie, Tom Price, Franco Putzolu, and Irving Traiger. The recovery manager of the System R database manager. ACM Computing Surveys, 13(2):223-242, June 1981.

Digital Library

[8]

J.N. Gray. Notes on database operating systems. In R. Bayer, R.M. Graham, and G. Seegmueller, editors, Operating Systems: An Advanced Course, pages 393-481. Springer-Verlag, 1979.

Digital Library

[9]

Roger Haskin, Dean Daniels, Wayne Sawdon, Daniel McNabb, and Jon Reinke. The QuickSilver recovery log service. In preparation, 1991.

[10]

Roger Haskin, Yoni Malachi, Wayne Sawdon, and Gregory Chan. Recovery management in Quick- Silver. A CM Transactions on Computer Systems, 6(1):82-108, February 1988.

Digital Library

[11]

John H. Howard, Michael L. Kazar, Sherri G. Menees, David A. Nichols, M. Satyanarayanan, Robert N. Sidebotham, and Michael j. West. Scale and performance in a distributed file system. A UM Transactions on Computer Systems, 6(1):51-81, February 1988.

Digital Library

[12]

Bruce G. Lindsay, Laura M. Haas, C. Mohan, Paul F. Wilms, and Robert A. Yost. Computation and communication in R*: A distributed database manager. A CM Transactions on Computer Systems, 2(1):24-38, February 1984.

Digital Library

[13]

Barbara Liskov et. aI. Argus reference manual. Technical Report MIT/LCS/TR-400, MIT, November 1987.

Digital Library

[14]

C. Mohan and B. Lindsay. Efficient commit protocols for the tree of process model of distributed transactions. Proceedings of the Second A CM Symposium on Principles of Distributed Computing, pages 76-88, August 1983.

Digital Library

[15]

Elliot B. Moss. Nested transactions: An approach to reliable distributed computing. Technical report, MIT Press, 1985.

Digital Library

[16]

R. Obermarck. Distributed deadlock detection algorithm. A CM Transactions on Database Systems, 7(2):187-208, June 1982.

Digital Library

[17]

Michael D. Schroeder and Michael Burrows. Performance of Firefly RPC. A CM Transactions on Computer Systems, 8(1):1-17, February 1990.

Digital Library

[18]

Matthew J. Weinstein, Thomas W. Page, Jr., Brian K. Livezey, and Gerald J. Popek. Transactions and synchronization in a distributed operating system. In Proceedings of the Tenth A CM Symposium on Operating System Principles, pages 115-126, December 1985.

Digital Library

Cited By

Aghayev AWeil SKuchnik MNelson MGanger GAmvrosiadis G(2020)The Case for Custom Storage Backends in Distributed Storage SystemsACM Transactions on Storage10.1145/338636216:2(1-31)Online publication date: 18-May-2020
https://dl.acm.org/doi/10.1145/3386362
Su WAurora AChen MZadok E(2020)Supporting Transactions for Bulk NFSv4 CompoundsProceedings of the 13th ACM International Systems and Storage Conference10.1145/3383669.3398275(75-86)Online publication date: 30-May-2020
https://dl.acm.org/doi/10.1145/3383669.3398275
Aghayev AWeil SKuchnik MNelson MGanger GAmvrosiadis GBrecht TWilliamson C(2019)File systems unfit as distributed storage backendsProceedings of the 27th ACM Symposium on Operating Systems Principles10.1145/3341301.3359656(353-369)Online publication date: 27-Oct-2019
https://dl.acm.org/doi/10.1145/3341301.3359656
Show More Cited By

Index Terms

Experience with transactions in QuickSilver
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database transaction processing
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Operating System Transactions
SOSP '09: Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles

Applications must be able to synchronize accesses to operating system resources in order to ensure correctness in the face of concurrency and system failures. System transactions allow the programmer to specify updates to heterogeneous system resources ...
Experience with transactions in QuickSilver

All programs in the QuickSilver distributed system behave atomically with respect to their updates to permanent data. Operating system support for transactions provides the framework required to support this, as well as a mechanism that unifies ...
Invalidating transactions: optimizations, theory, guarantees, and unification

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

September 1991

253 pages

ISBN:0897914473

DOI:10.1145/121132

Chairman:
Henry M. Levy
Univ. of Washington, Seattle

ACM SIGOPS Operating Systems Review Volume 25, Issue 5
Oct. 1991
253 pages
ISSN:0163-5980
DOI:10.1145/121133
Editor:
Henry M. Levy
Univ. of Washington, Seattle
Issue’s Table of Contents

Copyright © 1991 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1991

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP91

Sponsor:

SIGOPS

SOSP91: 13th ACM Symposium on Operating Systems Principles

October 13 - 16, 1991

California, Pacific Grove, USA

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
792
Total Downloads

Downloads (Last 12 months)97
Downloads (Last 6 weeks)23

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Aghayev AWeil SKuchnik MNelson MGanger GAmvrosiadis G(2020)The Case for Custom Storage Backends in Distributed Storage SystemsACM Transactions on Storage10.1145/338636216:2(1-31)Online publication date: 18-May-2020
Su WAurora AChen MZadok E(2020)Supporting Transactions for Bulk NFSv4 CompoundsProceedings of the 13th ACM International Systems and Storage Conference10.1145/3383669.3398275(75-86)Online publication date: 30-May-2020
Aghayev AWeil SKuchnik MNelson MGanger GAmvrosiadis GBrecht TWilliamson C(2019)File systems unfit as distributed storage backendsProceedings of the 27th ACM Symposium on Operating Systems Principles10.1145/3341301.3359656(353-369)Online publication date: 27-Oct-2019
DiLorenzo JMancini KFisher KFoster N(2019)TxForest: A DSL for Concurrent FilestoresProgramming Languages and Systems10.1007/978-3-030-34175-6_17(332-354)Online publication date: 18-Nov-2019
Wei MTai ARossbach CAbraham IMunshed MDhawan MStabile JWieder UFritchie SSwanson SFreedman MMalkhi DAkella AHowell J(2017)vCorfuProceedings of the 14th USENIX Conference on Networked Systems Design and Implementation10.5555/3154630.3154634(35-49)Online publication date: 27-Mar-2017
Escriva RSirer EArgyraki KIsaacs R(2016)The design and implementation of the Warp Transactional FilesystemProceedings of the 13th Usenix Conference on Networked Systems Design and Implementation10.5555/2930611.2930642(469-483)Online publication date: 16-Mar-2016
Shetty PSpillane RMalpani RAndrews BSeyster JZadok ESmith KZhou Y(2013)Building workload-independent storage with VT-treesProceedings of the 11th USENIX conference on File and Storage Technologies10.5555/2591272.2591275(17-30)Online publication date: 12-Feb-2013
Balakrishnan MMalkhi DDavis JPrabhakaran VWei MWobber T(2013)CORFUACM Transactions on Computer Systems10.1145/253593031:4(1-24)Online publication date: 20-Dec-2013
Kaminsky MDahlin M(2013)Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems PrinciplesundefinedOnline publication date: 3-Nov-2013
Payer MGross T(2012)Protecting applications against TOCTTOU races by user-space caching of file metadataACM SIGPLAN Notices10.1145/2365864.215105247:7(215-226)Online publication date: 3-Mar-2012
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents