Performance measurement of a parallel Input/Output system for the Intel iPSC/2 Hypercube
Pages 178 - 187
Abstract
The Intel Concurrent File System (CFS) for the iPSC/2 hypercube is one of the first production file systems to utilize the declustering of large files across numbers of disks to improve I/O performance. The CFS also makes use of dedicated I/O nodes, operating asynchronously, which provide file caching and prefetching. Processing of I/O requests is distributed between the compute node that initiates the request and the I/O nodes that service the request. The effects of the various design decisions in the Intel CFS are difficult to determine without measurements of an actual system. We present performance measurements of the CFS for a hypercube with 32 compute nodes and four I/0 nodes (four disks). Measurement of read/write rates for one compute node to one I/O node, one compute node to multiple I/O nodes, and multiple compute nodes to multiple I/O nodes form the basis for the study. Additional measurements show the effects of different buffer sizes, caching, prefetching, and file preallocation on system performance.
References
[1]
R.K. Asbury and D. S. Scott, "Fortran I/O on the iPSC/2: Is There Read after Write?" Proc. 4th Conf. on Hypercube Concurrent Computers and Applications, Monterey, Mar. 1989, i29-132.
[2]
L. Bomans and D. Roose, "Benchmarking the iPSC/2 Hypercube Multiprocessor", Concurrency: Practice and Experience 1, 1 (Sep. 1989), 3-18.
[3]
D.K. Bradley and D. A. Reed, "Performance of the Intel iPSC/2 input/Output System", Proc. 4th Conf. on Hypercube Concurrent Computers and Applications, Monterey, Mar. 1989, 141-144.
[4]
T.W. Crockett, "File Concepts for Parallel I/O", Proc. Supercomputing "89, Reno, Nevada, Nov. 1989, 574-579.
[5]
J. C. French and T. W. Pratt, "Performance Measurement of Two Parallel File Systems", Tech. Rep. IPC-TR-89-13 (Supercomputing "89 poster presentation), Institute for Parallel Computation, Thornton Hall, University of Virginia, Charlottesville, VA, Nov. 1989.
[6]
M.Y. Kim, "Synchronized Disk Interleaving", 1EEE Trans. on Computers C-35, 11 (Nov. 1986), 978-988.
[7]
D. Kotz and C. S. Ellis, "Prefetching in File Systems for MIMD Multiprocessors", 1EEE Trans. on Parallel and Distributed Systems 1, 2 (Apr. 1990), 218-230.
[8]
M. Livny, S. Khoshafian and H. Boral, "Multi-Disk Management Algorithms", Proc. of the 1987 ACM Sigmetrics Conf. on Measurement and Modeling of Computer Systems, May 1987, 69-77.
[9]
D. Patterson, G. Gibson and R. Katz, "A Case for Redundant Arrays of Inexpensive Disks (RAID)", Proc. of the Inter. Conf. on Management of Data, Chicago, IL, June 1988, 109-116.
[10]
P. Pierce, "The NX/2 Operating System", Proc. 3rd Conf. on Hypercube Concurrent Computers and Applications, Pasadena, Jan. 1988, 384-390.
[11]
P. Pierce, "A Concurrent File System for a Highly Parallel Mass Storage Subsystem", Proc. 4th Conf. on Hypercube Concurrent Computers and Applications, Monterey, Mar. 1989, 155-160.
[12]
T.W. Pratt, J. C. French, P. M. Dickens and S. A. Janet, "A Comparison of the Architecture and Performance of Two Parallel File Systems", Proc. 4th Conf. on Hypercube Concurrent Computers and Applications, Monterey, CA, Mar. 1989, 161-166.
[13]
A.L.N. Reddy and P. Banerjee, "An Evaluation of Multiple-Disk I/O Systems", IEEE Trans. on Computers 38, 12 (Dec. 1989), 1680-1690.
[14]
A.L.N. Reddy and P. Banerjee, "Design, Analysis, and Simulation of I/O Architectures for Hypercube Multiprocessors", IEEE Trans. on Parallel and D&tributed Systems 1, 2 (Apr. 1990), 140-151.
[15]
K. Salem and H. Garcia-Molina, "Disk Striping", Proc. of the Second Inter. Conf. on Data Engineering, 1986, 336-342.
Index Terms
- Performance measurement of a parallel Input/Output system for the Intel iPSC/2 Hypercube
Recommendations
Performance measurement of a parallel Input/Output system for the Intel iPSC/2 Hypercube
SIGMETRICS '91: Proceedings of the 1991 ACM SIGMETRICS conference on Measurement and modeling of computer systemsThe Intel Concurrent File System (CFS) for the iPSC/2 hypercube is one of the first production file systems to utilize the declustering of large files across numbers of disks to improve I/O performance. The CFS also makes use of dedicated I/O nodes, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 1991 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 April 1991
Published in SIGMETRICS Volume 19, Issue 1
Check for updates
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations11Total Citations
- 343Total Downloads
- Downloads (Last 12 months)108
- Downloads (Last 6 weeks)24
Reflects downloads up to 17 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in