Article

Free access

Informed prefetching of collective input/output requests

Authors:

Tara M. Madhyastha,

Garth A. Gibson,

Christos FaloutsosAuthors Info & Claims

SC '99: Proceedings of the 1999 ACM/IEEE conference on Supercomputing

Pages 13 - es

https://doi.org/10.1145/331532.331545

Published: 01 January 1999 Publication History

PDF eReader

References

[1]

BENNETT, R., BRYANT, K., SUSSMAN, A., DAS, R., AND SALTZ, J. Jovian: A Framework for Optimizing Parallel I/O. In Proceedings of the Scalable Parallel Libraries Conference (Mississippi State, MS, October 1994), IEEE Computer Society Press, pp. 10-20.

Google Scholar

[2]

CARDENAS, A. Analysis and Performance of Inverted Data Base Structures. CACM 18, 5 (May 1975), 253-263.

Digital Library

Google Scholar

[3]

CHEN,Y.,FOSTER, I., NIEPLOCHA, J., AND WINSLETT, M. Optimizing Collective I/O Performance on Parallel Computers: A Multisystem Study. In Proceedings of the 11th ACM International Conference on Supercomputing (July 1997), ACM Press, pp. 28-35.

Digital Library

Google Scholar

[4]

CHOUDHARY, A., BORDAWEKAR, R., HARRY, M., KRISHNAIYER, R., PONNUSAMY, R., SINGH,T.,AND THAKUR, R. PASSION: Parallel and Scalable Software for Input-Output. Tech. Rep. SCCS-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.

Google Scholar

[5]

CORBETT,P.,PROST, J.-P., DEMETRIOU, C., GIBSON, G., RIEDEL, E., ZELENKA, J., CHEN,Y.,FELTEN, E., LI, K., HARTMAN, J., PETERSON, L., BERSHAD, B., WOLMAN, A., AND AYDT, R. Proposal for a Common Parallel File System Programming Interface Version 1.0, 1996. Available at http://www.cs.arizona.edu/sio.

Google Scholar

[6]

CRANDALL, P. E., AYDT, R. A., CHIEN, A. A., AND REED, D. A. Characterization of a Suite of Input/Output Intensive Applications. In Proceedings of Supercomputing '95 (Dec. 1995).

Google Scholar

[7]

DEL ROSARIO, J. M., BORDAWEKAR, R., AND CHOUDHARY, A. Improved Parallel I/O via a Two-Phase Run- Time Access Strategy. In IPPS '93 Workshop on Input/Output in Parallel Computer Systems (1993), pp. 56-70. Also published in Computer Architecture News 21(5), December 1993, pages 31-38.

Digital Library

Google Scholar

[8]

GIBSON, G. A., NAGLE,D.F.,AMIRI, K., BUTLER, J., CHANG,F.W.,GOBIOFF, H., HARDIN, C., RIEDEL, E., ROCHBERG, D., AND ZELENKA, J. A Cost-Effective, High-Bandwidth Storage Architecture. In Proceedings of the Eighth Conference on Architectural Support for Programming Languages and Operating Systems (1998), ACM Press.

Digital Library

Google Scholar

[9]

HUBER, J., ELFORD, C. L., REED, D. A., CHIEN, A. A., AND BLUMENTHAL, D. S. PPFS: A High Performance Portable Parallel File System. In Proceedings of the 9th ACM International Conference on Supercomputing (Barcelona, July 1995), ACM Press, pp. 385-394.

Digital Library

Google Scholar

[10]

KIMBREL,T.,TOMKINS, A., PATTERSON, R. H., BERSHAD, B., CAO,P.,FELTEN,E.W.,GIBSON, G. A., KARLIN, A. R., AND LI, K. A Trace-Driven Comparison of Algorithms for Parallel Prefetching and Caching. In Proceedings of the USENIX Association Second Symposium on Operating Systems Design and Implementation (1996), pp. 19-34.

Digital Library

Google Scholar

[11]

KOTZ, D. Disk-directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems 15, 1 (February 1997), 41-74.

Digital Library

Google Scholar

[12]

KOTZ, D., TOH,S.B.,AND RADHAKRISHNAN, S. A Detailed Simulation Model of the HP 97560 Disk Drive. Tech. rep., Department of Computer Science, Dartmouth College, 1994.

Digital Library

Google Scholar

[13]

NEEDLEMAN, S. B., AND WUNSCH, C. D. An Efficient Method Applicable to the Search for Similarities in the Amino Acid Sequences of Two Proteins. Journal of Molecular Biology 48 (1970), 444-453.

Crossref

Google Scholar

[14]

PATTERSON, R. H., GIBSON,G.A.,GINTING, E., STODOLSKY, D., AND ZELENKA, J. Informed Prefetching and Caching. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles (Copper Mountain, CO, December 1995), ACM Press, pp. 79-95.

Digital Library

Google Scholar

[15]

RUEMMLER, C., AND WILKES, J. Modelling Disks. Tech. Rep. HPL-93-68, Hewlett Packard Laboratories, July 1993.

Google Scholar

[16]

SEAMONS, K. E., CHEN,Y.,JONES,P.,JOZWIAK, J., AND WINSLETT, M. Server-Directed Collective I/O in Panda. In Proceedings of Supercomputing '95 (San Diego, CA, December 1995), IEEE Computer Society Press.

Digital Library

Google Scholar

[17]

SMIRNI, E., AYDT, R. A., CHIEN, A. A., AND REED, D. A. I/O Requirements of Scientific Applications: An Evolutionary View. In Fifth International Symposium on High Performance Distributed Computing (1996), pp. 49- 59.

Digital Library

Google Scholar

[18]

STEERE, D. C. Using Dynamic Sets to Speed Search in World Wide Information Systems. Tech. Rep. CMU-CS- 95-174, School of Computer Science, Carnegie Mellon University, March 1995.

Crossref

Google Scholar

[19]

THAKUR,R. Runtime Support for In-Core and Out-of-Core Data-Parallel Programs. PhD thesis, Department of Electrical and Computer Engineering, Syracuse University, May 1995.

Digital Library

Google Scholar

[20]

THAKUR, R., AND CHOUDHARY, A. An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays. Tech. Rep. CACR-103, Scalable I/O Initiative, Center for Advanced Computing Research, Caltech, June 1995. Revised November 1995.

Digital Library

Google Scholar

[21]

THAKUR, R., CHOUDHARY, A., BORDAWEKAR, R., MORE, S., AND KUDITIPUDI, S. Passion: Optimized I/O for Parallel Applications. IEEE Computer 29, 6 (June 1996), 70-78.

Digital Library

Google Scholar

Cited By

View all

Al Assaf MJiang XQin XAbid MQiu MZhang J(2018)Informed Prefetching for Distributed Multi-Level Storage SystemsJournal of Signal Processing Systems10.1007/s11265-017-1277-z90:4(619-640)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s11265-017-1277-z
Valencio CDe Almeida FMachado JColombini ANeves LSouza R(2013)The Storage System for a Multimedia Data Manager Kernel2013 International Conference on Parallel and Distributed Computing, Applications and Technologies10.1109/PDCAT.2013.41(219-225)Online publication date: Dec-2013
https://doi.org/10.1109/PDCAT.2013.41
Al Assaf MAlghamdi MJiang XZhang JQin X(2012)A Pipelining Approach to Informed Prefetching in Distributed Multi-level Storage SystemsProceedings of the 2012 IEEE 11th International Symposium on Network Computing and Applications10.1109/NCA.2012.26(87-95)Online publication date: 23-Aug-2012
https://dl.acm.org/doi/10.1109/NCA.2012.26
Show More Cited By

Index Terms

Informed prefetching of collective input/output requests

Recommendations

Informed Prefetching for Distributed Multi-Level Storage Systems

In this paper, we present an informed prefetching technique called IPODS that makes use of application-disclosed access patterns to prefetch hinted blocks in distributed multi-level storage systems. We develop a prefetching pipeline in IPODS, where an ...
Stealth prefetching
Proceedings of the 2006 ASPLOS Conference

Prefetching in shared-memory multiprocessor systems is an increasingly difficult problem. As system designs grow to incorporate larger numbers of faster processors, memory latency and interconnect traffic increase. While aggressive prefetching ...
Informed Prefetching and Caching

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SC '99: Proceedings of the 1999 ACM/IEEE conference on Supercomputing

January 1999

1015 pages

ISBN:1581130910

DOI:10.1145/331532

General Chair:
Cherri Pancake

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SC '99

Sponsor:

SIGARCH
IEEE-CS

SC '99: International Conference for High Performance Computing, Networking, Storage and Analysis

November 14 - 19, 1999

Oregon, Portland, USA

Acceptance Rates

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
290
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Al Assaf MJiang XQin XAbid MQiu MZhang J(2018)Informed Prefetching for Distributed Multi-Level Storage SystemsJournal of Signal Processing Systems10.1007/s11265-017-1277-z90:4(619-640)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s11265-017-1277-z
Valencio CDe Almeida FMachado JColombini ANeves LSouza R(2013)The Storage System for a Multimedia Data Manager Kernel2013 International Conference on Parallel and Distributed Computing, Applications and Technologies10.1109/PDCAT.2013.41(219-225)Online publication date: Dec-2013
https://doi.org/10.1109/PDCAT.2013.41
Al Assaf MAlghamdi MJiang XZhang JQin X(2012)A Pipelining Approach to Informed Prefetching in Distributed Multi-level Storage SystemsProceedings of the 2012 IEEE 11th International Symposium on Network Computing and Applications10.1109/NCA.2012.26(87-95)Online publication date: 23-Aug-2012
https://dl.acm.org/doi/10.1109/NCA.2012.26
Yan BRhodes P(2006)An Iteration Aware Multidimensional Data Distribution Prototype for Computing Clusters2006 IEEE International Conference on Cluster Computing10.1109/CLUSTR.2006.311863(1-10)Online publication date: Sep-2006
https://doi.org/10.1109/CLUSTR.2006.311863
Li ZChen ZZhou Y(2005)Mining block correlations to improve storage performanceACM Transactions on Storage10.1145/1063786.10637901:2(213-245)Online publication date: 1-May-2005
https://dl.acm.org/doi/10.1145/1063786.1063790
Li ZChen ZSrinivasan SZhou Y(2004)C-MinerProceedings of the 3rd USENIX conference on File and storage technologies10.5555/1973374.1973387(13-13)Online publication date: 31-Mar-2004
https://dl.acm.org/doi/10.5555/1973374.1973387
Li ZChen ZSrinivasan SZhou Y(2004)C-Miner: Mining Block Correlations in Storage SystemsProceedings of the 3rd USENIX Conference on File and Storage Technologies10.5555/1096673.1096695(173-186)Online publication date: 31-Mar-2004
https://dl.acm.org/doi/10.5555/1096673.1096695

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Informed Prefetching for Distributed Multi-Level Storage Systems

Stealth prefetching

Informed Prefetching and Caching