research-article

Free access

A view of the parallel computing landscape

Authors:

Katherine YelickAuthors Info & Claims

Communications of the ACM, Volume 52, Issue 10

Pages 56 - 67

https://doi.org/10.1145/1562764.1562783

Published: 01 October 2009 Publication History

All formats PDF

Abstract

Writing programs that scale with increasing numbers of cores should be as easy as writing programs for sequential computers.

References

[1]

Adve, S. et al. Parallel Computing Research at Illinois: The UPCRC Agenda. White Paper. University of Illinois, Urbana-Champaign, IL, Nov. 2008.

Google Scholar

[2]

Agarwal, V., Liu, L.-K., and Bader, D. Financial modeling on the Cell broadband engine. In Proceedings of 22nd IEEE International Parallel and Distributed Processing Symposium (Miami, FL, Apr. 14--18, 2008).

Crossref

Google Scholar

[3]

Alexander, C. et al. A Pattern Language: Towns, Buildings, Construction. Oxford University Press, 1997.

Google Scholar

[4]

Asanovic, K. et al. The Parallel Computing Laboratory at U.C. Berkeley: A Research Agenda Based on the Berkeley View. UCB/EECS-2008-23, University of California, Berkeley, Mar. 21, 2008.

Google Scholar

[5]

Asanovic, K. et al. The Landscape of Parallel Computing Research: A View from Berkeley. UCB/EECS-2006-183, University of California, Berkeley, Dec. 18, 2006.

Google Scholar

[6]

Bader, D.A. and Patel, S. High-performance MPEG-2 software decoder on the Cell broadband engine. In Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium (Miami, FL, Apr. 14--18, 2008).

Crossref

Google Scholar

[7]

Buschmann, F. et al. Pattern-Oriented Software Architecture: A System of Patterns. John Wiley&Sons, Inc., New York, 1996.

Digital Library

Google Scholar

[8]

Clarke, D.G. et al. Ownership types for flexible alias protection. In Proceedings of the OOPSLA Conference (Vancouver, BC, Canada, 1998), 48--64.

Digital Library

Google Scholar

[9]

Datta, K. et al. Stencil computation optimization and autotuning on state-of-the-art multicore architectures. In Proceedings of the ACM/IEEE Supercomputing (SC) 2008 Conference (Austin, TX, Nov. 15--21). IEEE Press, Piscataway, NJ, 2008.

Digital Library

Google Scholar

[10]

Demmel, J., Dongarra, J., Eijkhout, V., Fuentes, E., Petitet, A., Vuduc, R., Whaley, R., and Yelick, K. Self-adapting linear algebra algorithms and software. Proceedings of the IEEE, Special Issue on Program Generation, Optimization, and Adaptation 93, 2 (Feb. 2005), 293--312.

Crossref

Google Scholar

[11]

Engler, D.R. Exokernel: An operating system architecture for application-level resource management. In Proceedings of the 15th Symposium on Operating Systems Principles (Cooper Mountain, CO, Dec. 3--6, 1995), 251--266.

Digital Library

Google Scholar

[12]

Gamma, E. et al. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional, Reading, MA, 1994.

Digital Library

Google Scholar

[13]

Gelernter, D. and Carriero, N. Coordination languages and their significance. Commun. ACM 35, 2 (Feb. 1992), 97--107.

Digital Library

Google Scholar

[14]

Henzinger, T.A. et al. Permissive interfaces. In Proceedings of the 10th European Software Engineering Conference (Lisbon, Portugal, Sept. 5--9). ACM Press, New York, 2005, 31--40.

Digital Library

Google Scholar

[15]

Hill, M. and Marty, M. Amdahl's Law in the multicore era. IEEE Computer 41, 7 (2008), 33--38.

Digital Library

Google Scholar

[16]

International Technology Roadmap for Semiconductors. Executive Summary, 2005 and 2007; http://public.itrs.net/.

Google Scholar

[17]

Kantowitz, B. and Sorkin, R. Human Factors: Understanding People-System Relationships. John Wiley&Sons, Inc., New York, 1983.

Google Scholar

[18]

Mattson, T., Sanders, B., and Massingill, B. Patterns for Parallel Programming. Addison-Wesley Professional, Reading, MA, 2004.

Digital Library

Google Scholar

[19]

O'Hanlon, C. A conversation with John Hennessy and David Patterson. Queue 4, 10 (Dec. 2005/Jan. 2006), 14--22.

Digital Library

Google Scholar

[20]

Patterson, D. and Hennessy, J. Computer Organization and Design: The Hardware/Software Interface, Fourth Edition. Morgan Kaufmann Publishers, Boston, MA, Nov. 2008.

Digital Library

Google Scholar

[21]

Sen, K. and Viswanathan, M. Model checking multithreaded programs with asynchronous atomic methods. In Proceedings of the 18th International Conference on Computer-Aided Verification (Seattle, WA, Aug. 17--20, 2006).

Digital Library

Google Scholar

[22]

Sen, K. et al. CUTE: A concolic unit testing engine for C. In Proceedings of the Fifth Joint Meeting European Software Engineering Conference (Lisbon, Portugal, Sept. 5--9). ACM Press, New York, 2005, 263--272.

Digital Library

Google Scholar

[23]

Shaw, M. and Garlan, D. An Introduction to Software Architecture. Technical Report CMU/SEI-94-TR-21, ESC-TR-94-21. CMU Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 1994.

Google Scholar

[24]

Shirako, J., Peixotto, D., Sarkar, V., and Scherer, W. Phasers: A unified deadlock-free construct for collective and point-to-point synchronization. In Proceedings of the 22nd ACM International Conference on Supercomputing (Island of Kos, Greece, June 7--12). ACM Press, New York, 2008, 277--288.

Digital Library

Google Scholar

[25]

Shirako, J., Kasahara, H., and Sarkar, V. Language extensions in support of compiler parallelization. In Proceedings of the 20th Workshop on Languages and Compilers for Parallel Computing (Urbana, IL, Oct. 11--13). Springer-Verlag, Berlin, 2007, 78--94.

Digital Library

Google Scholar

[26]

Thomas, D. et al. Agile Web Development with Rails, Second Edition. The Pragmatic Bookshelf, Raleigh, NC, 2008.

Digital Library

Google Scholar

[27]

UPC Language Specifications, Version 1.2. Technical Report LBNL-59208. Lawrence Berkeley National Laboratory, Berkeley, CA, 2005.

Google Scholar

[28]

Wawrzynek, J. et al. RAMP: Research Accelerator for Multiple Processors. IEEE Micro 27, 2 (Mar. 2007), 46--57.

Digital Library

Google Scholar

[29]

Williams, S., Waterman, A., and Patterson, D. Roofline: An insightful visual performance model for floating-point programs and multicore architectures. Commun. ACM 52, 4 (Apr. 2009), 65--76.

Digital Library

Google Scholar

[30]

Williams, S. et al. Lattice Boltzmann simulation optimization on leading multicore platforms. In Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium (Miami, FL, Apr. 14--18, 2008).

Google Scholar

[31]

Williams, S. et al. Optimization of sparse matrix-vector multiplication on emerging multicore platforms. In Proceedings of the Supercomputing (SC07) Conference (Reno, NV, Nov. 10--16). ACM Press, New York, 2007.

Digital Library

Google Scholar

Cited By

View all

Herrero-Pérez DMartínez-Barberá H(2025)Multi-GPU Acceleration for Finite Element Analysis in Structural MechanicsApplied Sciences10.3390/app1503109515:3(1095)Online publication date: 22-Jan-2025
https://doi.org/10.3390/app15031095
Yang YXu SHong YCai YTang WWang JShen BZong HYu G(2024)Computational modeling for medical data: From data collection to knowledge discoveryThe Innovation Life10.59717/j.xinn-life.2024.1000792:3(100079)Online publication date: 2024
https://doi.org/10.59717/j.xinn-life.2024.100079
Ahmad MSardar UBatyrshin IHasnain MSajid KSidorov G(2024)Elegante: A Machine Learning-Based Threads Configuration Tool for SpMV Computations on Shared Memory ArchitectureInformation10.3390/info1511068515:11(685)Online publication date: 1-Nov-2024
https://doi.org/10.3390/info15110685
Show More Cited By

Index Terms

A view of the parallel computing landscape

Recommendations

Another view on parallel speedup
Supercomputing '90: Proceedings of the 1990 ACM/IEEE conference on Supercomputing

In this paper three models of parallel speedup are studied. They are fixed-size speedup, fixed-time speedup and memory-bounded speedup. Two sets of speedup formulations are derived for these three models. One set requires more information and gives more ...
Analytical Modelling in Parallel and Distributed Computing
Parallel computing with x10
IWMSE '08: Proceedings of the 1st international workshop on Multicore software engineering

Many problems require parallel solutions and implementations and how to extract and specify parallelism has been the focus of Research during the last few decades. While there has been a significant progress in terms of (a)automatically deriving ...

Reviews

Reviewer: John P. Dougherty

This article covers substantial ground in providing a vision of what parallel computing needs to become in order to "save the world." OK, perhaps it is not that grandiose, but close. It is clear from the text that the authors believe that parallel computing must be a keystone for the next generation of computing, and this piece is their invitation for all to join them. After reviewing hardware limits and the resulting transition from single- to multi-core processors, the article notes the difficulties encountered when exploiting the potential of parallel computing, citing many past failed industrial attempts. Using a suspension bridge as their metaphor, future (that is, parallel) computing is a software span between the towers of hardware and applications. Too many ideas are presented to survey them all in this review, but they are all covered in enough detail to whet the appetite, with references for further information provided. I was intrigued by the idea of starting from applications to determine research directions; the authors present an initial set of five that they expect to expand in time. I am also interested in their exploration of design patterns in the context of parallel computing. The article is a view of parallel computing from the Par Lab at UC Berkeley, with a small section on other related projects tucked in at the end. I really enjoyed reading this article. It does not have as much technical detail as I had expected, but it is well written and full of energy about the topic. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Communications of the ACM Volume 52, Issue 10

A View of Parallel Computing

October 2009

134 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/1562764

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2009

Published in CACM Volume 52, Issue 10

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

444
Total Citations
View Citations
36,033
Total Downloads

Downloads (Last 12 months)1,153
Downloads (Last 6 weeks)115

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Herrero-Pérez DMartínez-Barberá H(2025)Multi-GPU Acceleration for Finite Element Analysis in Structural MechanicsApplied Sciences10.3390/app1503109515:3(1095)Online publication date: 22-Jan-2025
https://doi.org/10.3390/app15031095
Yang YXu SHong YCai YTang WWang JShen BZong HYu G(2024)Computational modeling for medical data: From data collection to knowledge discoveryThe Innovation Life10.59717/j.xinn-life.2024.1000792:3(100079)Online publication date: 2024
https://doi.org/10.59717/j.xinn-life.2024.100079
Ahmad MSardar UBatyrshin IHasnain MSajid KSidorov G(2024)Elegante: A Machine Learning-Based Threads Configuration Tool for SpMV Computations on Shared Memory ArchitectureInformation10.3390/info1511068515:11(685)Online publication date: 1-Nov-2024
https://doi.org/10.3390/info15110685
Friedman R(2024)Techniques for Theoretical Prediction of Immunogenic PeptidesEncyclopedia10.3390/encyclopedia40100384:1(600-621)Online publication date: 19-Mar-2024
https://doi.org/10.3390/encyclopedia4010038
Silva N(2024)Harnessing the Distributed Computing Paradigm for Laser-Induced Breakdown SpectroscopyBig Data and Cognitive Computing10.3390/bdcc81101548:11(154)Online publication date: 11-Nov-2024
https://doi.org/10.3390/bdcc8110154
Swatman SVarbanescu APimentel ASalzburger AKrasznahorkay ABalsamo SKnottenbelt WAbad CShang W(2024)Using Evolutionary Algorithms to Find Cache-Friendly Generalized Morton Layouts for ArraysProceedings of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629526.3645034(83-94)Online publication date: 7-May-2024
https://dl.acm.org/doi/10.1145/3629526.3645034
Chen YLi KWang YBai DWang LMa LYuan LZhang YCao TYang MLee IChabbi MSteuwer M(2024)ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor CoresProceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming10.1145/3627535.3638476(333-347)Online publication date: 2-Mar-2024
https://dl.acm.org/doi/10.1145/3627535.3638476
Chen JShen YWan Sung C(2024)A New Shift-Add Secret Sharing Scheme for Partial Data Protection With Parallel Zigzag DecodingIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.348849819(10221-10232)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIFS.2024.3488498
Willis BShrivastava AMack JDave SChakrabarti CBrunhaver J(2024)Cyclebite: Extracting Task Graphs From Unstructured Compute-ProgramsIEEE Transactions on Computers10.1109/TC.2023.332750473:1(221-234)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TC.2023.3327504
Saravanan VNavuluru SIbrahim K(2024)A Systematic Study of Parallelization Strategies for Optimizing Scientific Computing Performance Bounds2024 IEEE 37th International System-on-Chip Conference (SOCC)10.1109/SOCC62300.2024.10737865(1-6)Online publication date: 16-Sep-2024
https://doi.org/10.1109/SOCC62300.2024.10737865
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Another view on parallel speedup

Analytical Modelling in Parallel and Distributed Computing

Parallel computing with x10

Reviews

Access critical reviews of Computing literature here

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Funding Sources

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations