research-article

Simulation software engineering: experiences and challenges

Authors:

SE-HPCCSE '15: Proceedings of the 3rd International Workshop on Software Engineering for High Performance Computing in Computational Science and Engineering

Pages 1 - 4

https://doi.org/10.1145/2830168.2830171

Published: 15 November 2015 Publication History

Get Access

Abstract

Using software for large-scale simulations has become an important research method in many disciplines. With increasingly complex simulations, simulation software becomes a valuable assest. Yet, the quality of many simulation codes is worrying. In this paper, we want to collect and structure the challenges for a systematic simulation software engineering as a reference and the basis for further research. We describe our own experiences with developing simulation software and collaborating with non-computer-scientists. We complement our experienced challenges with a brief literature review. We structured the challenges for simulation software engineering into six areas: motivation and recognition; education and training; developer turnover; software length of life; verification, validation and debugging; and efficiency vs. maintainability. Overcoming these challenges needs efforts from research agencies, scientific computing researchers as well as software engineering researchers.

References

[1]

V. R. Basili, J. C. Carver, D. Cruzes, et al. Understanding the high-performance-computing community: A software engineer's perspective. IEEE Software, 25(4):29--36, 2008.

Digital Library

Google Scholar

[2]

J. Carver, D. Heaton, L. Hochstein, and R. Bartlett. Self-Perceptions about Software Engineering: A Survey of Scientists and Engineers. Computing in Science & Engineering, 15(1):7--11, Jan. 2013.

Digital Library

Google Scholar

[3]

J. C. Carver. Software Engineering for Computational Science and Engineering. Computing in Science & Engineering, 14(2):8--11, 2012.

Digital Library

Google Scholar

[4]

S. M. Easterbrook and T. C. Johns. Engineering the software for understanding climate change. Computing in Science & Engineering, 11(6), 2009.

Digital Library

Google Scholar

[5]

D. Heaton and J. C. Carver. Claims about the use of software engineering practices in science: A systematic literature review. Information and Software Technology, 67:207--219, 2015.

Digital Library

Google Scholar

[6]

J. Pitt-Francis, M. O. Bernabeu, J. Cooper, et al. Chaste: using agile programming techniques to develop computational biology software. Phil. Trans. of the Royal Society A: Mathematical, Physical and Engin. Sciences, 366(1878):3111--3136, Sept. 2008.

Crossref

Google Scholar

[7]

President's IT Advisory Committee. Computational science: Ensuring America's competitiveness. Report to the president, Executive Office of the President of the United States, 2005.

Google Scholar

[8]

S. Squires, M. Van De Vanter, and L. Votta. Yes, there is an "expertise gap" in HPC applications development. In Proc. 3rd International Workshop on Productivity and Performance in High-End Computing (PPHEC'06). IEEE, 2006.

Google Scholar

[9]

T. G. Trucano, D. E. Post, M. Pilch, and W. L. Oberkampf. Software engineering intersection with verification and validation of higher performance computational science software: Some observations. Technical Report SAND2005-3662P, Sandia National Laboratories, 2005.

Google Scholar

[10]

S. Turek, D. Göddeke, S. H. M. Buijssen, and H. Wobker. Hardware-oriented multigrid finite element solvers on gpu-accelerated cluster. In J. Kurzak, D. A. Bader, and J. Dongarra, editors, Scientific Computing with Multicore and Accelerators, Chapman & Hall/CRC Computational Science, pages 113--130. CRC Press, 2010.

Google Scholar

[11]

Wissenschaftsrat. Bedeutung und Weiterentwicklung von Simulation in der Wissenschaft. Position paper, Wissenschaftsrat, 2014.

Google Scholar

Cited By

View all

SAY B(2023)Bilimsel Yazılım Geliştirme Süreçleri için bir Yazılım Mühendisliği Yetkinlik EnvanteriA Software Engineering Competency Inventory for Scientific Software Development ProcessesTürkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi10.54525/tbbmd.115944316:2(170-176)Online publication date: 20-Nov-2023
https://doi.org/10.54525/tbbmd.1159443
Pflüger DMehl MValentin JLindner FPfander DWagner SGraziotin DWang Y(2016)The scalability-efficiency/maintainability-portability trade-off in simulation software engineeringProceedings of the Fourth International Workshop on Software Engineering for HPC in Computational Science and Engineering10.5555/3019106.3019110(19-27)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3019106.3019110
Pflüger DPfander D(2016)Computational efficiency vs. maintainability and portability. experiences with the sparse grid code SG++Proceedings of the Fourth International Workshop on Software Engineering for HPC in Computational Science and Engineering10.5555/3019106.3019109(10-18)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3019106.3019109
Show More Cited By

Index Terms

Simulation software engineering: experiences and challenges
1. Mathematics of computing
  1. Mathematical software
2. Software and its engineering

Recommendations

A Survey of Software Engineering Practice: Tools, Methods, and Results

The results of a survey of software development practice are reported and analyzed. The problems encountered in various phases of the software life cycle are measured and correlated with characteristics of the responding installations. The use and ...
Motivation in Software Engineering: A systematic literature review

Objective: In this paper, we present a systematic literature review of motivation in Software Engineering. The objective of this review is to plot the landscape of current reported knowledge in terms of what motivates developers, what de-motivates them ...
Development of a Software Engineering Ontology for Multisite Software Development

This paper aims to present an ontology model of software engineering to represent its knowledge. The fundamental knowledge relating to software engineering is well described in the textbook entitled Software Engineering by Sommerville that is now in its ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SE-HPCCSE '15: Proceedings of the 3rd International Workshop on Software Engineering for High Performance Computing in Computational Science and Engineering

November 2015

35 pages

ISBN:9781450340120

DOI:10.1145/2830168

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SC15

Sponsor:

SIGHPC
SIGARCH
IEEE-CS\DATC

SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis

November 15, 2015

Texas, Austin

Acceptance Rates

Overall Acceptance Rate 7 of 12 submissions, 58%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
428
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

SAY B(2023)Bilimsel Yazılım Geliştirme Süreçleri için bir Yazılım Mühendisliği Yetkinlik EnvanteriA Software Engineering Competency Inventory for Scientific Software Development ProcessesTürkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi10.54525/tbbmd.115944316:2(170-176)Online publication date: 20-Nov-2023
https://doi.org/10.54525/tbbmd.1159443
Pflüger DMehl MValentin JLindner FPfander DWagner SGraziotin DWang Y(2016)The scalability-efficiency/maintainability-portability trade-off in simulation software engineeringProceedings of the Fourth International Workshop on Software Engineering for HPC in Computational Science and Engineering10.5555/3019106.3019110(19-27)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3019106.3019110
Pflüger DPfander D(2016)Computational efficiency vs. maintainability and portability. experiences with the sparse grid code SG++Proceedings of the Fourth International Workshop on Software Engineering for HPC in Computational Science and Engineering10.5555/3019106.3019109(10-18)Online publication date: 13-Nov-2016
https://dl.acm.org/doi/10.5555/3019106.3019109
Pfluger DPfander D(2016)Computational Efficiency vs. Maintainability and Portability. Experiences with the Sparse Grid Code SG++2016 Fourth International Workshop on Software Engineering for High Performance Computing in Computational Science and Engineering (SE-HPCCSE)10.1109/SE-HPCCSE.2016.007(17-25)Online publication date: Nov-2016
https://doi.org/10.1109/SE-HPCCSE.2016.007

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A Survey of Software Engineering Practice: Tools, Methods, and Results

Motivation in Software Engineering: A systematic literature review

Development of a Software Engineering Ontology for Multisite Software Development