Article

Achieving Robust, Scalable Cluster I/O in Java

Authors:

David E. CullerAuthors Info & Claims

LCR '00: Selected Papers from the 5th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers

Pages 16 - 31

Published: 25 May 2000 Publication History

Abstract

We present Tigris, a high-performance computation and I/O substrate for clusters of workstations that is implemented entirely in Java. Tigris automatically balances resource load across the cluster as a whole, shielding applications from asymmetries in CPU, I/O, and network performance. This is accomplished through the use of a dataflow programming model coupled with a work-balancing distributed queue. To meet the performance challenges of implementing such a system in Java, Tigris relies on Jaguar, a system that enables direct, protected access to hardware resources, including fast network interfaces and disk I/O. Jaguar yields an order-of-magnitude performance boost over the Java Native Interface for Java bindings to system resources. We demonstrate the applicability of Tigris through a one-pass, parallel, disk-to-disk sort exhibiting high performance.

References

[1]

Y. Aridor, M. Factor, A. Teperman, T. Eilam, and A. Schuster. A high performance cluster jvm presenting a pure single system image. In Proceedings of the ACM 2000 JavaGrande Conference, San Francisco, CA, June 2000.

[2]

R. H. Arpaci, A. Dusseau, A. M. Vahdat, L. T. Liu, T. E. Anderson, and D. A. Patterson. The interaction of parallel and sequential workloads on a network of workstations. In Proceedings of SIGMETRICS/PERFORMANCE, May 1995.

[3]

A. Arpaci-Dusseau, R. Arpaci-Dusseau, D. E. Culler, J. M. Hellerstein, and D. A. Patterson. Searching for the sorting record: Experiences in tuning NOW-Sort. In Proceedings of the 1998 Symposium on Parallel and Distributed Tools (SPDT '98), 1998.

[4]

A. C. Arpaci-Dusseau, D. E. Culler, and A. Mainwaring. Scheduling with implicit information in distributed systems. In 1998 SIGMETRICS Conference on the Measurement and Modeling of Computer Systems, pages 233-243, June 1998.

[5]

R. Arpaci-Dusseau, E. Anderson, N. Treuhaft, D. Culler, J. Hellerstein, D. Patterson, and K. Yelick. Cluster I/O with River: Making the fast case common. In IOPADS '99, 1999. http://www.cs.berkeley.edu/~remzi/Postscript/river.ps.

[6]

R. Avnur and J. M. Hellerstein. Eddies: Continuously Adaptive Query Processing. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, May 2000.

[7]

P. Buonadonna, J. Coates, S. Low, and D. E. Culler. Millennium Sort: A Cluster-Based Application for Windows NT Using DCOM, River Primitives and the Virtual Interface Architecture. In Proceedings of the 3rd USENIX Windows NT Symposium, July 1999.

[8]

P. Buonadonna, A. Geweke, and D. Culler. An implementation and analysis of the Virtual Interface Architecture. In Proceedings of SC'98, November 1998.

[9]

B. Chun, A. Mainwaring, and D. Culler. Virtual network transport protocols for Myrinet. IEEE Micro, 18(1), January/February 1998.

[10]

G. Copeland, W. Alexander, E. Boughter, and T. Keller. Data Placement in Bubba. SIGMOD Record, 17(3):99-108, September 1988.

[11]

D. J. DeWitt, S. Ghanderaizadeh, and D. Schneider. A Performance Analysis of the Gamma Database Machine. SIGMOD Record, 17(3):350-360, September 1988.

[12]

Anon et. al. A measure of transaction processing power. In Datamation, 31(7): 112-118, February 1985.

[13]

G. Graefe. Encapsulation of Parallelism in the Volcano Query Processing System. SIGMOD Record, 19(2):102-111, June 1990.

[14]

S. Gribble, M. Welsh, D. Culler, and E. Brewer. Multispace: An evolutionary platform for infrastructural services. In Proceedings of the 16th USENIX Annual Technical Conference, Monterey, California, 1999.

[15]

Y. Charlie Hu, Weimin Yu, Dan Wallach, Alan Cox, and Willy Zwaenepoel. Run-time support for distributed sharing in typed languages. In Proceedings of the Fifth ACM Workshop on Languages, Compilers, and Run-time Systems for Scalable Computers, Rochester, NY, May 2000.

[16]

J. Huber, C. L. Elford, D. A. Reed, A. A. Chien, and D. S. Blumenthal. PPFS: A high performance portable parallel file system. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 385-394, July 1995.

[17]

J. Moreira, S. Midkiff, and M. Gupta. From flop to megaflops: Java for technical computing. In Proceedings of the 11th Workshop on Languages and Compilers for Parallel Computing (LCPC'98), 1998. http://www.research.ibm.com/ninja/.

[18]

M. Philippsen and M. Zenger. JavaParty - transparent remote objects in Java. In Concurrency: Practice and Experience, 9(11):1225-1242, November 1997.

[19]

Sun Microsystems Inc. Enterprise Java Beans Technology. http://java.sun.com/products/ejb/.

[20]

Sun Microsystems Inc. Java HotSpot Performance Engine. http://java.sun.com/products/hotspot/index.html.

[21]

Sun Microsystems Inc. Java Native Interface Specification. http://java.sun.com/products/jdk/1.2/docs/guide/jni/index.html.

[22]

Sun Microsystems Labs. The Exact Virtual Machine (EVM). http://www.sunlabs.com/research/java-topics/.

[23]

H. Takagi, S. Matsuoka, H. Nakada, S. Sekiguchi, M. Satoh, and U. Nagashima. Ninflet: A migratable parallel objects framework using Java. In ACM 1998 Workshop on Java for High-Performance Network Computing, 1998. http://www.cs.ucsb.edu/conferences/java98/papers/ninflet.eps.

[24]

UC Berkeley Ninja Project. http://ninja.cs.berkeley.edu.

[25]

UC Berkeley NOW Project. The UC Berkeley Network of Workstations Project. http://now.cs.berkeley.edu.

[26]

UC Berkeley Telegraph Project. http://db.cs.berkeley.edu/telegraph/.

[27]

T. von Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A user-level network interface for parallel and distributed computing. In Proceedings of the 15th Annual Symposium on Operating System Principles, December 1995.

[28]

M. Welsh and D. Culler. Jaguar: Enabling efficient communication and I/O from Java. Concurrency: Practice and Experience, 2000. Special Issue on Java for High-Performance Network Computing, To appear, http://www.cs.berkeley.edu/~mdw/proj/jaguar.

[29]

A. Woo, Z. Mao, and H. So. The Berkeley JAWS Project. http://www.cs.berkeley.edu/~awoo/cs262/jaws.html.

[30]

Yelick, Semenzato, Pike, Miyamoto, Liblit, Krishnamurthy, Hilfinger, Graham, Gay, Colella, and Aiken. Titanium: A high-performance Java dialect. In ACM 1998 Workshop on Java for High-Performance Network Computing, February 1998.

Cited By

Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGOPS Operating Systems Review10.1145/635508.60542536:5(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/635508.605425
Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGARCH Computer Architecture News10.1145/635506.60542530:5(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/635506.605425
Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGPLAN Notices10.1145/605432.60542537:10(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/605432.605425
Show More Cited By

Index Terms

Achieving Robust, Scalable Cluster I/O in Java
1. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language types

Index terms have been assigned to the content through auto-classification.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

LCR '00: Selected Papers from the 5th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers

May 2000

299 pages

ISBN:3540411852

Editor:
Sandhya Dwarkadas

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 25 May 2000

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGOPS Operating Systems Review10.1145/635508.60542536:5(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/635508.605425
Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGARCH Computer Architecture News10.1145/635506.60542530:5(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/635506.605425
Sivathanu MArpaci-Dusseau AArpaci-Dusseau R(2002)Evolving RPC for active storageACM SIGPLAN Notices10.1145/605432.60542537:10(264-276)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1145/605432.605425
Sivathanu MArpaci-Dusseau AArpaci-Dusseau RGharachorloo KWood D(2002)Evolving RPC for active storageProceedings of the 10th international conference on Architectural support for programming languages and operating systems10.1145/605397.605425(264-276)Online publication date: 5-Oct-2002
https://dl.acm.org/doi/10.1145/605397.605425

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents