Abstract
Parallel file systems often work guided by APIs which provide hints to access storage in a coordinated manner. Nevertheless, the current APIs do not offer the expressiveness necessary to specify I/O operations conveniently in irregular applications. We characterize the state of irregular applications that precedes the performance degradation of the parallel file system and we propose a schedule based on profile information.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System for Linux Clusters. In: 4th Annual Linux Showcase and Conference, pp. 317–327 (2000)
Centro de Supercomputación y Visualización de Madrid (CeSViMa): http://www.cesvima.upm.es
Ching, A., Choudgary, A., Liao, W.: Noncontiguous I/O through PVFS. In: Proceedings of the IEEE International Conference on Cluster Computing, pp. 405–414 (2002)
IBM.: IBM General Parallel File System High Performance Cluster File System, http://www-03.ibm.com/servers/eserver/clusters/software/gpfs.html
The MPI Forum: MPI-2: Extensions to the Message-Passing Interface (1997)
Prost, J.-P., Treumann, R., Blackmore, R., Hartman, C., Hedges, R., Jia, B., Koniges, A., White, A.: Towards a High-Performance Implementation of MPI-IO on Top of GPFS. In: Bode, A., Ludwig, T., Karl, W.C., Wismüller, R. (eds.) Euro-Par 2000. LNCS, vol. 1900, pp. 1253–1262. Springer, Heidelberg (2000)
Purakayastha, A., Ellis, C.S., Kotz, D.: ENWRICH: A Compute-Processor Write Caching Scheme for Parallel File Systems. In: The Fourth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS), pp. 55–68 (1996)
Schmuck, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: FAST 2002 Conference on File and Storage Technologies, pp. 231–244 (2002)
Thakur, R., Lusk, E., Gropp, W.: I/O in Parallel Applications: The Weakest Link. The International Journal of High Performance Computing Applications 12(4), 389–395 (1998)
Thakur, R., Gropp, W., Lusk, E.: Data Sieving and Collective I/O in ROMIO. In: Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, pp. 182–189 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ibáñez, M.B., García, F., Carretero, J. (2006). A Profiling Approach for the Management of Writing in Irregular Applications. In: Min, G., Di Martino, B., Yang, L.T., Guo, M., Rünger, G. (eds) Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops. ISPA 2006. Lecture Notes in Computer Science, vol 4331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11942634_27
Download citation
DOI: https://doi.org/10.1007/11942634_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49860-5
Online ISBN: 978-3-540-49862-9
eBook Packages: Computer ScienceComputer Science (R0)