Memory capacity aware non-blocking data transfer on GPGPU

HW Liu, HK Kuo, KT Chen, BCC Lai - SiPS 2013 Proceedings, 2013 - ieeexplore.ieee.org
HW Liu, HK Kuo, KT Chen, BCC Lai
SiPS 2013 Proceedings, 2013ieeexplore.ieee.org
The massive data demand of GPGPUs requires expensive memory modules, such as
GDDR, to support high data bandwidth. The high cost poses constraints on the total memory
capacity available to GPGPU s, and the data need to be transferred between the host CPUs
and GPGPUs. However, the long latency of data transfers has resulted in significant
performance overhead. To alleviate this issue, the modem GPGPUs have implemented the
non-blocking data transfer allowing a GPGPU to perform computing while the data is being …
The massive data demand of GPGPUs requires expensive memory modules, such as GDDR, to support high data bandwidth. The high cost poses constraints on the total memory capacity available to GPGPU s, and the data need to be transferred between the host CPUs and GPGPUs. However, the long latency of data transfers has resulted in significant performance overhead. To alleviate this issue, the modem GPGPUs have implemented the non-blocking data transfer allowing a GPGPU to perform computing while the data is being transmitted. This paper proposes a capacity aware scheduling algorithm that exploits the non-blocking data transfer in modern GPGPUs. By effectively taking the advantage of non-blocking transfers, experiment results demonstrate an average of 24.01 % performance improvement when compared to existing approaches that only consider memory capacity.
ieeexplore.ieee.org
Showing the best result for this search. See all results