Article

Free access

An end-to-end approach to globally scalable network storage

Authors:

James S. PlankAuthors Info & Claims

SIGCOMM '02: Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications

Pages 339 - 346

https://doi.org/10.1145/633025.633058

Published: 19 August 2002 Publication History

Abstract

This paper discusses the application of end-to-end design principles, which are characteristic of the architecture of the Internet, to network storage. While putting storage into the network fabric may seem to contradict end-to-end arguments, we try to show not only that there is no contradiction, but also that adherence to such an approach is the key to achieving true scalability of shared network storage. After discussing end-to-end arguments with respect to several properties of network storage, we describe the Internet Backplane Protocol and the exNode, which are tools that have been designed to create a network storage substrate that adheres to these principles. The name for this approach is Logistical Networking, and we believe its use is fundamental to the future of truly scalable communication.

References

[1]

Gnutella, 2001. http://gnutella.wego.com/

[2]

Napster, 2001. http://www.napster.com

[3]

Bassi, A., Beck, M. and Moore, T., Mobile Management of Network Files. in Third Annual International Workshop on Active Middleware Services, (San Franscisco, 2001).

Digital Library

[4]

Beck, M. and Moore, T. The Internet2 Distributed Storage Infrastructure Project: An Architecture for Internet Content Channels. Computer Networking and ISDN Systems, 30 (22-23). 2141--2148

Digital Library

[5]

Cerf, V., Burleigh, S., Hooke, A., Torgerson, L., Durst, R., Scott, K., Travis, E. and Weiss, H., Interplanetary Internet (IPN): Architectural Definition, IETF Internet Draft, 2001. http://www.ietf.org/internet-drafts/draft-irtf-ipnrg-arch-00.txt

[6]

Chen, P.M., Lee, E.K., Gibson, G.A., Katz, R.H. and Patterson, D.A. RAID: High-performance, reliable secondary storage. ACM Computing Surveys, 26. 145--185

Digital Library

[7]

Dennis, J. and Horn, E.V. Programming semantics for multiprogrammed computations. Communications of the ACM, 9 (3). 143--155

Digital Library

[8]

Fagg, G.E., Moore, K., Dongarra, J.J. and Geist, A., Scalable Network Information Processing Environment (SNIPE). in Proceedings of SuperComputing '97, (San Jose, CA, USA, 1997).

Digital Library

[9]

Moore, K., Browne, S., Cox, J. and Gettler, J., Resource Cataloging and Distribution Systemb, University of Tennessee, UT-CS-97-346. http://www.netlib.org/utk/projects/rcds/rcds-tr/main.html.

Digital Library

[10]

Morris, J.H., Satyanarayan, M., Conner, M.H., Howard, J.H., Rosenthal, D.S.H. and Smith, F.D. Andrew: A Distributed Personal Computing Environment. Communications of the ACM, 29 (3). 184--201.March

Digital Library

[11]

Plank, J.S. A Tutorial on Reed-Solomon Coding for Fault-Tolerance in RAID-like Systems. Software -- Practice and Experience, 27 (9). 995--1012.September

Digital Library

[12]

Plank, J.S., Bassi, A., Beck, M., Moore, T., Swany, M. and Wolski, R. Managing Data Storage in the Network. IEEE Internet Computing, 5 (5). 50--58.September/October

Digital Library

[13]

Quinlan, S. and Dorward, S., Venti: a new approach to archival storage. in USENIX File and Storage Technologies (FAST) 2002, (Monterey, CA, 2002).

Digital Library

[14]

Rabinovich, M. and Spatscheck, O., Web Caching and Replication. Addison-Wesley, 2001.

Digital Library

[15]

Ratnasamy, S., Francis, P., Handley, M. and Karp, R., A Scalable Content-Addressable Network. in ACM SIGCOMM, (2000).

Digital Library

[16]

Reed, D.P., Saltzer, J.H. and Clark, D.D. Comment on Active Networking and End-to-End Arguments. IEEE Network, 12 (3). 69--71.May/June

Digital Library

[17]

Saltzer, J.H., Reed, D.P. and Clark, D.D. End-to-End Arguments in System Design. ACM Transactions on Computer Systems, 2 (4). 277--288.November

Digital Library

[18]

Stoica, I., Morris, R., Karger, D., Kaashoek, F. and (MIT), H.B., Chord: A Scalable Peer-To-Peer Lookup Service for Internet Applications. in ACM SIGCOMM, (2001).

Digital Library

[19]

Verma, D.C., Content Distribution Networks: An Engineering Approach. Wiley, 2001.

Digital Library

[20]

Waldo, J., Wyant, G., Wollrath, A. and Kendall, S., A note on distributed computing, Sun Microsystems, TR-94-29. November.

[21]

Watson, R.W. and Coyne, R.A., The Parallel I/O Architecture of the High-Performance Storage System (HPSS). in IEEE Mass Storage Systems Symposium, (1995), IEEE Computer Society Press.

Digital Library

Cited By

Beck M(2020)Deployment Scalability in Exposed Buffer Processing2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)10.1109/MASS50613.2020.00035(211-219)Online publication date: Dec-2020
https://doi.org/10.1109/MASS50613.2020.00035
Beck MMoore TLuszczek PDanalis A(2019)Interoperable Convergence of Storage, Networking, and Computation10.1007/978-3-030-12385-7_48(667-690)Online publication date: 2-Feb-2019
https://doi.org/10.1007/978-3-030-12385-7_48
Cartledge CNelson M(2015)When should I make preservation copies of myself?International Journal on Digital Libraries10.1007/s00799-015-0155-116:3-4(183-205)Online publication date: 21-Jun-2015
https://doi.org/10.1007/s00799-015-0155-1
Show More Cited By

Index Terms

An end-to-end approach to globally scalable network storage
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Networks

Recommendations

An end-to-end approach to globally scalable network storage
Proceedings of the 2002 SIGCOMM conference

This paper discusses the application of end-to-end design principles, which are characteristic of the architecture of the Internet, to network storage. While putting storage into the network fabric may seem to contradict end-to-end arguments, we try to ...
An end-to-end approach to globally scalable programmable networking

The three fundamental resources underlying Information Technology are bandwidth, storage, and computation. The goal of wide area infrastructure is to provision these resources to enable applications within a community. The end-to-end principles provide ...
An end-to-end approach to globally scalable programmable networking
FDNA '03: Proceedings of the ACM SIGCOMM workshop on Future directions in network architecture

The three fundamental resources underlying Information Technology are bandwidth, storage, and computation. The goal of wide area infrastructure is to provision these resources to enable applications within a community. The end-to-end principles provide ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '02: Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications

August 2002

368 pages

ISBN:158113570X

DOI:10.1145/633025

Conference Chairs:
Matt Mathis
Pittsburgh Supercomputing Center
,
Peter Steenkiste
Carnegie Mellon University
,
Program Chairs:
Hari Balakrishnan
Massachusetts Institute of Technology
,
Vern Paxson
ICIR

ACM SIGCOMM Computer Communication Review Volume 32, Issue 4
Proceedings of the 2002 SIGCOMM conference
October 2002
332 pages
ISSN:0146-4833
DOI:10.1145/964725
Issue’s Table of Contents

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 August 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGCOMM02

Sponsor:

SIGCOMM02: SIGCOMM 2002 Conference

August 19 - 23, 2002

Pennsylvania, Pittsburgh, USA

Acceptance Rates

SIGCOMM '02 Paper Acceptance Rate 25 of 300 submissions, 8%;

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

72
Total Citations
View Citations
1,937
Total Downloads

Downloads (Last 12 months)90
Downloads (Last 6 weeks)19

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Beck M(2020)Deployment Scalability in Exposed Buffer Processing2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)10.1109/MASS50613.2020.00035(211-219)Online publication date: Dec-2020
https://doi.org/10.1109/MASS50613.2020.00035
Beck MMoore TLuszczek PDanalis A(2019)Interoperable Convergence of Storage, Networking, and Computation10.1007/978-3-030-12385-7_48(667-690)Online publication date: 2-Feb-2019
https://doi.org/10.1007/978-3-030-12385-7_48
Cartledge CNelson M(2015)When should I make preservation copies of myself?International Journal on Digital Libraries10.1007/s00799-015-0155-116:3-4(183-205)Online publication date: 21-Jun-2015
https://doi.org/10.1007/s00799-015-0155-1
Cartledge CNelson MBuchanan GKlein MRauber ACunningham S(2014)When should I make preservation copies of myself?Proceedings of the 14th ACM/IEEE-CS Joint Conference on Digital Libraries10.5555/2740769.2740771(1-10)Online publication date: 8-Sep-2014
https://dl.acm.org/doi/10.5555/2740769.2740771
Cartledge CNelson M(2014)When should i make preservation copies of myself?IEEE/ACM Joint Conference on Digital Libraries10.1109/JCDL.2014.6970143(1-10)Online publication date: Sep-2014
https://doi.org/10.1109/JCDL.2014.6970143
Smaldone SGilbert BHarkes JIftode LSatyanarayanan M(2013)Optimizing Storage Performance for VM-Based Mobile ComputingACM Transactions on Computer Systems10.1145/2465346.246534831:2(1-25)Online publication date: 1-May-2013
https://dl.acm.org/doi/10.1145/2465346.2465348
Liu HGao JHuang JBeck MMoore T(2012)On-Demand Visualization on Scalable Shared InfrastructureData Intensive Distributed Computing10.4018/978-1-61520-971-2.ch012(275-290)Online publication date: 2012
https://doi.org/10.4018/978-1-61520-971-2.ch012
DeMarle DGeveci BWoodring JAhrens J(2012)Streaming and Out-of-Core MethodsHigh Performance Visualization10.1201/b12985-13Online publication date: 13-Nov-2012
https://doi.org/10.1201/b12985-13
Kim HLee DChon KJang BKwon TChoi Y(2010)Performance impact of large file transfer on web proxy caching: A case study in a high bandwidth campus network environmentJournal of Communications and Networks10.1109/JCN.2010.638843412:1(52-66)Online publication date: Feb-2010
https://doi.org/10.1109/JCN.2010.6388434
Gu YGrossman R(2010)SectorFuture Generation Computer Systems10.1016/j.future.2009.05.00926:5(720-728)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1016/j.future.2009.05.009
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten