Scalable parallel I/O on a Blue Gene/Q supercomputer using compression, topology-aware data aggregation, and subfiling
H Bui, H Finkel, V Vishwanath, S Habib… - … , and Network-Based …, 2014 - ieeexplore.ieee.org
2014 22nd Euromicro International Conference on Parallel …, 2014•ieeexplore.ieee.org
In this paper, we propose an approach to improving the I/O performance of an IBM Blue
Gene/Q supercomputing system using a novel framework that can be integrated into high
performance applications. We take advantage of the system's tremendous computing
resources and high interconnection bandwidth among compute nodes to efficiently exploit
I/O bandwidth. This approach focuses on lossless data compression, topology-aware data
movement, and subfiling. The efficacy of this solution is demonstrated using …
Gene/Q supercomputing system using a novel framework that can be integrated into high
performance applications. We take advantage of the system's tremendous computing
resources and high interconnection bandwidth among compute nodes to efficiently exploit
I/O bandwidth. This approach focuses on lossless data compression, topology-aware data
movement, and subfiling. The efficacy of this solution is demonstrated using …
In this paper, we propose an approach to improving the I/O performance of an IBM Blue Gene/Q supercomputing system using a novel framework that can be integrated into high performance applications. We take advantage of the system's tremendous computing resources and high interconnection bandwidth among compute nodes to efficiently exploit I/O bandwidth. This approach focuses on lossless data compression, topology-aware data movement, and subfiling. The efficacy of this solution is demonstrated using microbenchmarks and an application-level benchmark.
ieeexplore.ieee.org