Article

Apex-Map: A Global Data Access Benchmark to Analyze HPC Systems and Parallel Programming Paradigms

Authors:

Erich Strohmaier,

Hongzhang ShanAuthors Info & Claims

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

Page 49

https://doi.org/10.1109/SC.2005.13

Published: 12 November 2005 Publication History

Get Access

Abstract

The memory wall and global data movement have become thedominant performance bottleneck for many scientific applications.New characterizations of data access streams and related benchmarks to measure their performances are therefore needed to compare HPC systems,software, and programming paradigms effectively. In this paper, weintroduce a novel global data access benchmark, Apex-Map. It is a parameterized synthetic performance probe and integrates concepts fortemporal and spatial locality into its design. We measured Apex-Map performancefor a whole range of temporal and spatial localities on several advanced processors and parallel computing platforms and use the generatedperformance surfaces forperformance comparisons and to study the characteristicsof these different architectures. We demonstrate that the results of Apex-Mapclearly reflect many specific characteristics of the used systems. We also show the utility of Apex-Map for analyzing the performance effects of threeleading parallel programming models and demonstrate their relative merits.

References

[1]

{1} Top500 Super Computer Sites, http://www.top500.org

Google Scholar

[2]

{2} Application Performance Characterization benchmarking, http://ftg.lbl.gov

Google Scholar

[3]

{3} STREAM: http://www.cs.virginia.edu/stream/

Google Scholar

[4]

{4} HPC Challenge Benchmark, http://icl.cs.utk.edu/hpcc/

Google Scholar

[5]

{5} MAPS: http://www.sdsc.edu/PMaC/MAPs/maps.html

Google Scholar

[6]

{6} NAS Parallel Benchmarks: http://www.nas.nasa.gov/Software/NPB/

Google Scholar

[7]

{7} SPEC: http://www.spec.org/

Google Scholar

[8]

{8} Erich Strohmaier and Hongzhang Shan, "Apex-Map: A Synthetic Scalable Benchmark Probe to Explore Data Access Performance on Highly Parallel Systems", EuroPar2005, Lisbon, Portugal, Aug. 2005.

Digital Library

Google Scholar

[9]

{9} Erich Strohmaier and Hongzhang Shan, "Architecture Independent Performance Characterization and Benchmarking for Scientific Applications", International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, Volendam, The Netherlands, Oct. 2004.

Digital Library

Google Scholar

[10]

{10} Berkeley UPC- Unified Parallel C, http://upc.nersc.gov

Google Scholar

Cited By

View all

Kwon MLee SJung MTarasov VZhang YAnwar AMi N(2023)Cache in Hand: Expander-Driven CXL Prefetcher for Next Generation CXL-SSDProceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3599691.3603406(24-30)Online publication date: 9-Jul-2023
https://dl.acm.org/doi/10.1145/3599691.3603406
Jung MAnwar ASkourtis DKannan SMa X(2022)Hello bytes, bye blocksProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539745(45-51)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3538643.3539745
Lavin PYoung JVuduc RRiedy JVose AErnst D(2020)Evaluating Gather and Scatter Performance on CPUs and GPUsProceedings of the International Symposium on Memory Systems10.1145/3422575.3422794(209-222)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3422575.3422794
Show More Cited By

Index Terms

Recommendations

Apex-Map: a synthetic scalable benchmark probe to explore data access performance on highly parallel systems
Euro-Par'05: Proceedings of the 11th international Euro-Par conference on Parallel Processing

With the increasing gap between processor, memory, and interconnect speed, the performances of scientific applications on high performance computing systems have become dominated by the ability to move global data. However, many benchmarks in the field ...
APEX-Map: a parameterized scalable memory access probe for high-performance computing systems: Research Articles
Parallel and Distributed Computing (EuroPar 2005)

The memory wall between the peak performance of microprocessors and their memory performance has become the prominent performance bottleneck for many scientific application codes. New benchmarks measuring data access speeds locally and globally in a ...
Characterizing the Relation Between Apex-Map Synthetic Probes and Reuse Distance Distributions
ICPP '10: Proceedings of the 2010 39th International Conference on Parallel Processing

Characterizing a memory reference stream using reuse distance distribution can enable predicting the performance on a given architecture. Benchmarks can subject an architecture to a limited set of reuse distance distributions, but it cannot exhaustively ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

November 2005

829 pages

ISBN:1595930612

General Chair:
William Kramer

Publisher

IEEE Computer Society

United States

Publication History

Published: 12 November 2005

Check for updates

Qualifiers

Article

Conference

SC '05

Sponsor:

SIGARCH
IEEE-CS

SC '05: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 18, 2005

Acceptance Rates

SC '05 Paper Acceptance Rate 62 of 260 submissions, 24%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
268
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kwon MLee SJung MTarasov VZhang YAnwar AMi N(2023)Cache in Hand: Expander-Driven CXL Prefetcher for Next Generation CXL-SSDProceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3599691.3603406(24-30)Online publication date: 9-Jul-2023
https://dl.acm.org/doi/10.1145/3599691.3603406
Jung MAnwar ASkourtis DKannan SMa X(2022)Hello bytes, bye blocksProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539745(45-51)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3538643.3539745
Lavin PYoung JVuduc RRiedy JVose AErnst D(2020)Evaluating Gather and Scatter Performance on CPUs and GPUsProceedings of the International Symposium on Memory Systems10.1145/3422575.3422794(209-222)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3422575.3422794
Ibrahim KFatollahi-Fard FDonofrio DShalf JJacob B(2016)Characterizing the Performance of Hybrid Memory Cube Using ApexMAP Application ProbesProceedings of the Second International Symposium on Memory Systems10.1145/2989081.2989090(429-436)Online publication date: 3-Oct-2016
https://dl.acm.org/doi/10.1145/2989081.2989090
Alizadeh MJavanmard AChuang SIyer SLu Y(2012)Versatile refreshACM SIGMETRICS Performance Evaluation Review10.1145/2318857.225478740:1(247-258)Online publication date: 11-Jun-2012
https://dl.acm.org/doi/10.1145/2318857.2254787
Alizadeh MJavanmard AChuang SIyer SLu YHarrison PArlitt MCasale G(2012)Versatile refreshProceedings of the 12th ACM SIGMETRICS/PERFORMANCE joint international conference on Measurement and Modeling of Computer Systems10.1145/2254756.2254787(247-258)Online publication date: 11-Jun-2012
https://dl.acm.org/doi/10.1145/2254756.2254787
Weinberg JSnavely APapatheodorou TBanerjee UMendelson AGallivan K(2008)Accurate memory signatures and synthetic address traces for HPC applicationsProceedings of the 22nd annual international conference on Supercomputing10.1145/1375527.1375536(36-45)Online publication date: 7-Jun-2008
https://dl.acm.org/doi/10.1145/1375527.1375536
Alam SBhatia NVetter J(2007)An exploration of performance attributes for symbolic modeling of emerging processing devicesProceedings of the Third international conference on High Performance Computing and Communications10.5555/2401945.2402021(683-694)Online publication date: 26-Sep-2007
https://dl.acm.org/doi/10.5555/2401945.2402021
Pakin S(2007)The Design and Implementation of a Domain-Specific Language for Network Performance TestingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2007.106518:10(1436-1449)Online publication date: 1-Oct-2007
https://dl.acm.org/doi/10.1109/TPDS.2007.1065
Shan HStrohmaier EQiang JBailey DYelick KHorner-Miller B(2006)Performance modeling and optimization of a high energy colliding beam simulation codeProceedings of the 2006 ACM/IEEE conference on Supercomputing10.1145/1188455.1188557(97-es)Online publication date: 11-Nov-2006
https://dl.acm.org/doi/10.1145/1188455.1188557

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Apex-Map: a synthetic scalable benchmark probe to explore data access performance on highly parallel systems

APEX-Map: a parameterized scalable memory access probe for high-performance computing systems: Research Articles

Characterizing the Relation Between Apex-Map Synthetic Probes and Reuse Distance Distributions