Article

Integrating Database Technology with Comparison-based Parallel Performance Diagnosis: The PerfTrack Performance Experiment Management Tool

Authors:

Karen L. Karavanic,

Kathryn Mohror,

Brian PughAuthors Info & Claims

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

Page 39

https://doi.org/10.1109/SC.2005.36

Published: 12 November 2005 Publication History

Abstract

PerfTrack is a data store and interface for managing performance data from large-scale parallel applications. Data collected in different locations and formats can be compared and viewed in a single performance analysis session. The underlying data store used in PerfTrack is implemented with a database management system (DBMS). PerfTrack includes interfaces to the data store and scripts for automatically collecting data describing each experiment, such as build and platform details. We have implemented a prototype of PerfTrack that can use Oracle or PostgreSQL for the data store. We demonstrate the prototype's functionality with three case studies: one is a comparative study of an ASC purple benchmark on high-end Linux and AIX platforms; the second is a parameter study conducted at Lawrence Livermore National Laboratory (LLNL) on two high end platforms, a 128 node cluster of IBM Power 4 processors and BlueGene/L; the third demonstrates incorporating performance data from the Paradyn Parallel Performance Tool into an existing PerfTrack data store.

References

[1]

{1} Trolltech, "QT3. 3 Whitepaper," April 20, 2005. (available at www.trolltech.com).

[2]

{2} G. v. Rossum, "Python Reference Manual Release 2.3.4," PythonLabs May 20, 2004. (available at www.python.org).

[3]

{3} A. Tuininga, "cx_Oracle," Release 4.1 betal Computronix, 2004. (available at http://starship.python.net/crew/atuining/cx_Oracle/html/about.html).

[4]

{4} D'Arcy J. M. Cain, "PyGreSQL Version 3.6.2." (http://www.pygresql.org/).

[5]

{5} E. Ipek, Bronis de Supinski, Martin Schulz, and Sally A. McKee, "An Approach to Performance Prediction for Parallel Applications," submitted for publication, 2005.

[6]

{6} "mpiP: Lightweight, Scalable MPI Profiling." (available at www.llnl.gov/CASC/mpip).

[7]

{7} "Performance Monitor API Programming," in Performance Tools Guide and Reference. (available at http://publib16 boulder.ibm.com/doc_link/en_US/a_doc_lib/aixbman/prftools/mastertoc.htm#mtoc).

[8]

{8} "About ASC Purple." (available at www.llnl.gov/asci/platforms/purple/index.html).

[9]

{9} B. P. Miller, M. D. Callaghan, J. M. Cargille, J. K. Hollingsworth, R. B. Irvin, K. L. Karavanic, K. Kunchithapadam, T. Newhall, "The Paradyn Parallel Performance Measurement Tool," IEEE Computer, vol. 28, pp. 37-46, 1995.

Digital Library

[10]

{10} R. Snodgrass, "A Relational Approach to Monitoring Complex Systems," ACM Transactions on Computer Systems, vol. 6, pp. 157-196, 1988.

Digital Library

[11]

{11} V. Taylor, X. Wu, and R. Stevens, "Prophesy: An Infrastructure for Performance Analysis and Modeling of Parallel and Grid Applications," ACM SIGMETRICS Performance Evaluation Review, vol. 30, 2003.

Digital Library

[12]

{12} X. Wu, V. Taylor, J. Geisler, X. Li, Z. Lan, R. Stevens, M. Hereld and I. R. Judson, "Design and Development of Prophesy Performance Database for Distributed Scientific Applications," presented at 10th SIAM Conference on Parallel Processing for Scientific Computing, Virginia, USA, 2001.

[13]

{13} S. Adve, R. Bagrodia, J. C. Browne, E. Deelman, A. Dube, E. Houstis, J. Rice, R. Sakellariou, D. Sundaram-Stuken, P.J. Teller, and M. K. Vernon, "POEMS: End-to-end Performance Design of Large Parallel Adaptive Computational Systems," IEEE Transactions on Software Engineering, vol. 26, pp. 1027-1048, 2000.

Digital Library

[14]

{14} K. L. Karavanic, and B. P. Miller, "Improving Online Performance Diagnosis by the Use of Historical Performance Data," presented at SC99, Portland, Oregon, USA, 1999.

Digital Library

[15]

{15} E. N. Houstis, A. C. Catlin, J. R. Rice, V. S. Verykios, N. Ramakrishnan, and C. Houstis, "PYTHIA-II: A Knowledge/Database System for Managing Performance Data and Recommending Scientific Software," ACM Transactions on Mathematical Software, vol. 26, pp. 227-253, 2000.

Digital Library

[16]

{16} K. Huck, A. D. Malony, R. Bell, A. Morris, "Design and Implementation of a Parallel Performance Data Management Framework," presented at The 2005 International Conference on Parallel Processing (ICPP), to appear, Oslo, Norway, 2005.

Digital Library

[17]

{17} H. Truong, and T. Fahringer, "On Utilizing Experiment Data Repository for Performance Analysis of Parallel Applications," presented at 9th International Euro-Par Conference (Euro-Par 2003), Klagenfurt, Austria, 2003.

[18]

{18} K. L. Karavanic, and B. P. Miller, "Experiment Management Support for Performance Tuning," presented at SC97, San Jose, California, USA, 1997.

Digital Library

[19]

{19} K. L. Karavanic, "Experiment Management Support for Parallel Performance Tuning," in Computer Science. Madison, Wisconsin: University of Wisconsin - Madison, 1999.

[20]

{20} K. L. Karavanic, and B. P. Miller, "A Framework for Multi-Execution Performance Tuning," in On-Line Monitoring Systems and Computer Tool Interoperability, T. L. a. B. P. Miller, Ed. New York, USA: Nova Science Publishers, 2003.

Digital Library

[21]

{21} F. Song, F. Wolf, N. Bhatia, J. Dongarra, S. Moore, "An Algebra for Cross-Experiment Performance Analysis," presented at 2004 International Conference on Parallel Processing (ICPP-04), Montreal, Quebec, CANADA, 2004.

Digital Library

[22]

{22} M. Colgrove, C. Hansen, K.L. Karavanic, "Managing Parallel Performance Experiments with PPerfDB," presented at The IASTED International Conference on Parallel and Distributed Computing and Networking (PDCN 2005), Innsbruck, Austria, 2005.

[23]

{23} R. Prodan, T. Fahringer, "ZENTURIO: An Experiment Management System for Cluster and Grid Computing," presented at 4th International Conference on Cluster Computing (CLUSTER 2002), Chicago, USA, 2002.

Digital Library

Cited By

Brink SMcKinsey MBoehme DScully-Allison CLumsden IHawkins DBurgess TLama VLüttgau JIsaacs KTaufer MPearce OButt AMi NChard K(2023)Thicket: Seeing the Performance Experiment Forest for the Individual Run TreesProceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing10.1145/3588195.3592989(281-293)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3588195.3592989
Giménez AGamblin TBhatele AWood CShoga KMarathe ABremer PHamann BSchulz MMohr BRaghavan P(2017)ScrubJayProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3126908.3126935(1-12)Online publication date: 12-Nov-2017
https://dl.acm.org/doi/10.1145/3126908.3126935
Schulz Mde Supinski B(2007)Practical differential profilingProceedings of the 13th international Euro-Par conference on Parallel Processing10.5555/2391541.2391555(97-106)Online publication date: 28-Aug-2007
https://dl.acm.org/doi/10.5555/2391541.2391555
Show More Cited By

Index Terms

Integrating Database Technology with Comparison-based Parallel Performance Diagnosis: The PerfTrack Performance Experiment Management Tool

Recommendations

Query-based Performance Comparison of Graph Database and Relational Database
SoICT '22: Proceedings of the 11th International Symposium on Information and Communication Technology

A graph database is a type of NoSQL database that uses graph structure for semantic queries with nodes, edges, and properties to represent and store data. It has been applied in many fields, such as education, health, business, and social network, with ...
A Comparison of 12 Parallel FORTRAN Dialects

A simple program that approximates pi by numerical quadrature is rewritten to run on nine commercially available processors to illustrate the compilations that arise in parallel programming in FORTRAN. The machines used are the Alliant FX/8, BBN ...
Parallel algorithms for database operations and a database operation for parallel algorithms
IPPS '95: Proceedings of the 9th International Symposium on Parallel Processing

This paper establishes some significant links between two areas: (i) relational parallel database systems; and (ii) the design and analysis of parallel algorithms. The paper begins with a fundamental but very simple observation: implementing a JOIN ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

November 2005

829 pages

ISBN:1595930612

General Chair:
William Kramer

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

IEEE Computer Society

United States

Publication History

Published: 12 November 2005

Check for updates

Qualifiers

Article

Conference

SC '05

Sponsor:

SIGARCH
IEEE-CS

SC '05: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 18, 2005

Acceptance Rates

SC '05 Paper Acceptance Rate 62 of 260 submissions, 24%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
427
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Brink SMcKinsey MBoehme DScully-Allison CLumsden IHawkins DBurgess TLama VLüttgau JIsaacs KTaufer MPearce OButt AMi NChard K(2023)Thicket: Seeing the Performance Experiment Forest for the Individual Run TreesProceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing10.1145/3588195.3592989(281-293)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3588195.3592989
Giménez AGamblin TBhatele AWood CShoga KMarathe ABremer PHamann BSchulz MMohr BRaghavan P(2017)ScrubJayProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3126908.3126935(1-12)Online publication date: 12-Nov-2017
https://dl.acm.org/doi/10.1145/3126908.3126935
Schulz Mde Supinski B(2007)Practical differential profilingProceedings of the 13th international Euro-Par conference on Parallel Processing10.5555/2391541.2391555(97-106)Online publication date: 28-Aug-2007
https://dl.acm.org/doi/10.5555/2391541.2391555
Mohror KKaravanic KYelick KMellor-Crummey J(2007)A study of tracing overhead on a high-performance linux clusterProceedings of the 12th ACM SIGPLAN symposium on Principles and practice of parallel programming10.1145/1229428.1229465(158-159)Online publication date: 14-Mar-2007
https://dl.acm.org/doi/10.1145/1229428.1229465
Alameh RZazworka NHollingsworth J(2007)Performance Measurement of Novice HPC Programmers CodeProceedings of the 3rd International Workshop on Software Engineering for High Performance Computing Applications10.1109/SE-HPC.2007.4Online publication date: 20-May-2007
https://dl.acm.org/doi/10.1109/SE-HPC.2007.4

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents