article

Free access

On Reporting Computational Experiments with Mathematical Software

Editor: John R. Rice Authors:

Harlan Crowder,

Ron S. Dembo,

John M. MulveyAuthors Info & Claims

ACM Transactions on Mathematical Software (TOMS), Volume 5, Issue 2

Pages 193 - 203

https://doi.org/10.1145/355826.355833

Published: 01 June 1979 Publication History

PDF eReader

References

[1]

AIRD, T., BATTISTE, E.L, AND GREGORY, W.C. Portability of mathematical software coded m Fortran. ACM Trans. Math Software 3, 2 (June 1977), 113-127.

Crossref

Google Scholar

[2]

ANDERSON, V.L, AND MCLEAN, 1~ A. Design of Experiments" A Realistic Approach. Dekker, New York, 1974

Google Scholar

[3]

ANSI FORTRAN X3.9-1978, American National Standards Institute, New York, 1978.

Google Scholar

[4]

DEMBO, R.S, AND MULVEY, J M On the analyms and comparison of mathematical programming algorithms and software In National Bureau of Standards Special Publication 502, W.W. White, Ed., U S Department of Commerce, Washington, D.C, 1978, pp. 106-116.

Google Scholar

[5]

HOFFMAN, A., MANNOS, M., SOKOLOWSKY, D, AND WIEGMANN, N. Computational experience m solving linear programs SIAM J 1 (1953), 1-33

Google Scholar

[6]

IGNIZIO, J.P. Validating claims for algorithms proposed for publication. Oper. Res. 21, 3 (May 1973), 852-854

Google Scholar

[7]

IGNIZIO, J P On the estabhshment of standards for comparing algorithm performance. Interfaces 2, 1 (Nov 1971), 8-11.

Google Scholar

[8]

JACKSON, R.H., AND MULVEY, J.M. A critical review of methods for comparing mathematical programming algorithms and software' 1951-1977. Presented at The Institute of Management Science Syrup. XXIII, Athens, July 1977.

Google Scholar

[9]

LIN, BOY., AND RARDIN, F~.L. Controlled experimental design for comparison of integer programmmg algorithms. J-76-25, Industrial and Systems Engineering, Georgia Inst. of Technology, Atlanta, Ga, 1976.

Google Scholar

Cited By

View all

Landeta-López PGuevara-Vega C(2024)Computational Experiments in Computer Science Research: A Literature SurveyIEEE Access10.1109/ACCESS.2024.345880812(132254-132270)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3458808
Willemsen FSchoonhoven RFilipovič JTørring Jvan Nieuwpoort Rvan Werkhoven B(2024)A methodology for comparing optimization algorithms for auto-tuningFuture Generation Computer Systems10.1016/j.future.2024.05.021159(489-504)Online publication date: Oct-2024
https://doi.org/10.1016/j.future.2024.05.021
Ntaimo LNtaimo L(2024)Computational ExperimentationComputational Stochastic Programming10.1007/978-3-031-52464-6_10(465-504)Online publication date: 10-Jan-2024
https://doi.org/10.1007/978-3-031-52464-6_10
Show More Cited By

Index Terms

On Reporting Computational Experiments with Mathematical Software
1. Mathematics of computing
  1. Mathematical software

Recommendations

Reporting computational experiments in mathematical programming

This paper presents a set of recommended standards for the presentation of computational experiments in mathematical programming.
Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask
ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

Experimentation is a key issue in science and engineering. But it is one of software engineering's stumbling blocks. Quite a lot of experiments are run nowadays, but it is a risky business. Software engineering has some special features, leading to some ...
Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask
ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Experimentation is a key issue in science and engineering. But it is one of software engineering's stumbling blocks. Quite a lot of experiments are run nowadays, but it is a risky business. Software engineering has some special features, leading to some ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Mathematical Software

ACM Transactions on Mathematical Software Volume 5, Issue 2

June 1979

115 pages

ISSN:0098-3500

EISSN:1557-7295

DOI:10.1145/355826

Editor:
John R. Rice

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1979

Published in TOMS Volume 5, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

67
Total Citations
View Citations
971
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)14

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Landeta-López PGuevara-Vega C(2024)Computational Experiments in Computer Science Research: A Literature SurveyIEEE Access10.1109/ACCESS.2024.345880812(132254-132270)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3458808
Willemsen FSchoonhoven RFilipovič JTørring Jvan Nieuwpoort Rvan Werkhoven B(2024)A methodology for comparing optimization algorithms for auto-tuningFuture Generation Computer Systems10.1016/j.future.2024.05.021159(489-504)Online publication date: Oct-2024
https://doi.org/10.1016/j.future.2024.05.021
Ntaimo LNtaimo L(2024)Computational ExperimentationComputational Stochastic Programming10.1007/978-3-031-52464-6_10(465-504)Online publication date: 10-Jan-2024
https://doi.org/10.1007/978-3-031-52464-6_10
Bai YOlinick E(2022)A Composite Index Method for Optimization BenchmarkingLearning and Intelligent Optimization10.1007/978-3-031-24866-5_4(43-57)Online publication date: 5-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-24866-5_4
Fehr JHimpe CRave SSaak J(2021)Sustainable Research Software Hand-OverJournal of Open Research Software10.5334/jors.3079Online publication date: 30-Apr-2021
https://doi.org/10.5334/jors.307
Bartz-Beielstein TRehbach FRebolledo M(2021)Tuning Algorithms for Stochastic Black-Box Optimization: State of the Art and Future PerspectivesBlack Box Optimization, Machine Learning, and No-Free Lunch Theorems10.1007/978-3-030-66515-9_3(67-108)Online publication date: 4-Jan-2021
https://doi.org/10.1007/978-3-030-66515-9_3
Sörensen KArnold FPalhazi Cuervo D(2017)A critical analysis of the “improved Clarke and Wright savings algorithm”International Transactions in Operational Research10.1111/itor.1244326:1(54-63)Online publication date: 14-Aug-2017
https://doi.org/10.1111/itor.12443
Lin EWu C(2017)The multiple-choice multi-period knapsack problemJournal of the Operational Research Society10.1057/palgrave.jors.260166155:2(187-197)Online publication date: 21-Dec-2017
https://doi.org/10.1057/palgrave.jors.2601661
Kendall GBai RBłazewicz JDe Causmaecker PGendreau MJohn RLi JMcCollum BPesch EQu RSabar NBerghe GYee A(2017)Good Laboratory Practice for optimization researchJournal of the Operational Research Society10.1057/jors.2015.7767:4(676-689)Online publication date: 21-Dec-2017
https://doi.org/10.1057/jors.2015.77
Beiranvand VHare WLucet Y(2017)Best practices for comparing optimization algorithmsOptimization and Engineering10.1007/s11081-017-9366-118:4(815-848)Online publication date: 19-Sep-2017
https://doi.org/10.1007/s11081-017-9366-1
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

References

Cited By

Index Terms

Recommendations

Reporting computational experiments in mathematical programming

Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask

Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations