Article

DEVStone: a Benchmarking Technique for Studying Performance of DEVS Modeling and Simulation Environments

Authors:

Ezequiel Glinsky,

Gabriel WainerAuthors Info & Claims

DS-RT '05: Proceedings of the 9th IEEE International Symposium on Distributed Simulation and Real-Time Applications

Pages 265 - 272

https://doi.org/10.1109/DISTRA.2005.18

Published: 10 October 2005 Publication History

Publisher Site

Abstract

DEVS is a sound, formal modeling and simulation (M&S) framework that supports hierarchical, modular model composition. DEVS-based M&S environments have been used successfully to understand, analyze, and develop a wide variety of systems. As the systems under study become larger and more complex, the performance of the simulator becomes critical. Nevertheless, evaluating the performance of such simulators is a complex process that requires the execution of large numbers of models with different characteristics. We present DEVStone, a synthetic benchmark devoted to automate the evaluation of DEVS-based simulation approaches, which generates models similar to those existing in the real world. DEVStone facilitates performance analysis for successive versions (e.g., upgrades or fixes) of the same simulation engine, and provides a common metric to compare different M&S environments.

References

[1]

Zeigler, B.; Kim, T.; Praehofer, H. Theory of Modeling and Simulation. Academic Press. 2000.

Digital Library

Google Scholar

[2]

Wainer, G. "CD++: a toolkit to develop DEVS models". Software - Practice and Experience. vol. 32, pp. 1261- 1306. 2002.

Digital Library

Google Scholar

[3]

Troccoli, A; Wainer, G. "Implementing Parallel Cell-DEVS". Proceedings of 36th IEEE/SCS Annua Simulation Symposium. Orlando, USA 2003.

Digital Library

Google Scholar

[4]

Glinsky, E.; Wainer, G. "Definition of RT simulation in the CD++ toolkit". Proc. of the Summer Computer Simulation Conference. San Diego, CA. 2002.

Google Scholar

[5]

Davidson, A.; Wainer, G. "Specifying truck movement in traffic models using Cell-DEVS". Proc. of the 33rd Annual Simulation Symposium. Washington, DC. 2000.

Digital Library

Google Scholar

[6]

Lo Tartaro, M.; Torres, C.; Wainer, G. "Defining Models of Urban Traffic using the TSC Tool". Proc. of the Winter Simulation Conference. Washington, DC. 2001.

Digital Library

Google Scholar

[7]

Díaz, A; Vázquez, V.; Wainer, G. "Application of the ATLAS language in models of urban traffic". Proc. of the Annual Simulation Symposium. Seattle, WA. 2001.

Digital Library

Google Scholar

[8]

Ameghino, J.; Troccoli, A; Wainer, G. "Models of complex physical systems using Cell-DEVS". Proc. of the Annual Simulation Symposium. Seattle, WA. 2001.

Digital Library

Google Scholar

[9]

Ameghino, J.; Wainer, G.; Glinsky, E. "Applying Cell-DEVS in Models of Complex Systems". Proc. of the Summer Computer Simulation Conference. Montreal, QC. 2003.

Google Scholar

[10]

Wainer, G.; S. Daicz, S.; De Simoni, L.; Wasserman, D. "Using the ALFA-1 simulated processor for educational purposes". ACM Journal on Educational Resources in Computing. 1(4). pp. 111-151. 2001.

Digital Library

Google Scholar

[11]

Weicker, R. P. "Dhrystone: A synthetic systems programming benchmark". Communications of the ACM, volume 27, pages 1013-1030, 1984.

Digital Library

Google Scholar

[12]

Chow, A.; Zeigler, B. "Parallel DEVS: A parallel, hierarchical, modular modeling formalism". Proc. of the Winter Simulation Conference. Orlando, FL. 1994.

Digital Library

Google Scholar

[13]

Martin, D.; McBrayer, T.; Radhakrishan, R.; Wilsey, P. "Time Warp Parallel Discrete Event Simulator". Technical report. Computer Architecture Design Laboratory. University of Cincinnati. USA. 1997.

Google Scholar

[14]

Kim, K.; Kang W.; Sagong, B.; Seo, H. "Efficient Distributed Simulation of Hierarchical DEVS Models: Transforming Model Structure into a Non-Hierarchical One". Proc. of the 33rd Annual Simulation Symposium. Washington DC, USA. 2000.

Digital Library

Google Scholar

Cited By

View all

Cárdenas RHenares KArroba PRisco-Martín JWainer G(2022)The DEVStone Metric: Performance Analysis of DEVS Simulation EnginesACM Transactions on Modeling and Computer Simulation10.1145/354384932:3(1-20)Online publication date: 25-Jul-2022
https://dl.acm.org/doi/10.1145/3543849
Köster TUhrmacher AAndelfinger P(2022)Towards an Open Repository for Reproducible Performance Comparison of Parallel and Distributed Discrete-Event SimulatorsProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3534989(31-32)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3534989
Martelloni PQuesnel GInnocenti EBisgambiglia PGonsolin PBisgambiglia PBarros FHu XDenil JSarjoughian H(2018)Component-based simulation for spatial complex systems in VLE environmentProceedings of the Theory of Modeling and Simulation Symposium10.5555/3213187.3213195(1-12)Online publication date: 15-Apr-2018
https://dl.acm.org/doi/10.5555/3213187.3213195
Show More Cited By

Index Terms

Recommendations

Experiences with the DEVStone benchmark
SpringSim '08: Proceedings of the 2008 Spring simulation multiconference

DEVS is a formal modeling and simulation (M&S) framework that supports hierarchical, modular model composition. DEVS-based M&S environments have been used successfully to understand, analyze, and develop a variety of systems. As the systems under study ...
The DEVStone Metric: Performance Analysis of DEVS Simulation Engines
The DEVStone benchmark allows us to evaluate the performance of discrete-event simulators based on the Discrete Event System (DEVS) formalism. It provides model sets with different characteristics, enabling the analysis of specific issues of simulation ...
Studying performance of DEVS modeling and simulation environments using the DEVStone benchmark

The Discrete Event System Specification (DEVS) formal modeling and simulation (M&S) framework (which supports hierarchical and modular model composition) has been widely used to understand, analyze and develop a variety of systems. Numerous DEVS ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

DS-RT '05: Proceedings of the 9th IEEE International Symposium on Distributed Simulation and Real-Time Applications

October 2005

296 pages

ISBN:0769524621

Publisher

IEEE Computer Society

United States

Publication History

Published: 10 October 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cárdenas RHenares KArroba PRisco-Martín JWainer G(2022)The DEVStone Metric: Performance Analysis of DEVS Simulation EnginesACM Transactions on Modeling and Computer Simulation10.1145/354384932:3(1-20)Online publication date: 25-Jul-2022
https://dl.acm.org/doi/10.1145/3543849
Köster TUhrmacher AAndelfinger P(2022)Towards an Open Repository for Reproducible Performance Comparison of Parallel and Distributed Discrete-Event SimulatorsProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3534989(31-32)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3534989
Martelloni PQuesnel GInnocenti EBisgambiglia PGonsolin PBisgambiglia PBarros FHu XDenil JSarjoughian H(2018)Component-based simulation for spatial complex systems in VLE environmentProceedings of the Theory of Modeling and Simulation Symposium10.5555/3213187.3213195(1-12)Online publication date: 15-Apr-2018
https://dl.acm.org/doi/10.5555/3213187.3213195
Martelloni PQuesnel GInnocenti EBisgambiglia PGonsolin PBisgambiglia P(2018)Component-based simulation for spatial complex systems in VLE environmentProceedings of the 4th ACM International Conference of Computing for Engineering and Sciences10.1145/3213187.3213195(1-12)Online publication date: 6-Jul-2018
https://dl.acm.org/doi/10.1145/3213187.3213195
Van Tendeloo YVangheluwe H(2017)An evaluation of DEVS simulation toolsSimulation10.5555/3059156.305915793:2(103-121)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.5555/3059156.3059157
Risco-Martín JMittal SFabero Jiménez JZapater MHermida Correa R(2017)Reconsidering the performance of DEVS modeling and simulation environments using the DEVStone benchmarkSimulation10.1177/003754971769044793:6(459-476)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1177/0037549717690447
Cardoen BManhaeve STuijn TVan Tendeloo YVanmechelen KVangheluwe HBroeckhove JBarros FPrähofer HHu XDenil J(2016)Performance analysis of a PDEVS simulator supporting multiple synchronization protocolsProceedings of the Symposium on Theory of Modeling & Simulation10.5555/2975389.2975393(1-8)Online publication date: 3-Apr-2016
https://dl.acm.org/doi/10.5555/2975389.2975393
Paris TTan AChevrier VCiarletta LPadilla JTolk AJafer S(2016)Study about decomposition and integration of continuous systems in discrete environmentProceedings of the 49th Annual Simulation Symposium10.5555/2962374.2962391(1-8)Online publication date: 3-Apr-2016
https://dl.acm.org/doi/10.5555/2962374.2962391
Bae JBae SMoon IKim T(2016)Efficient Flattening Algorithm for Hierarchical and Dynamic Structure Discrete Event ModelsACM Transactions on Modeling and Computer Simulation10.1145/287535626:4(1-25)Online publication date: 22-Feb-2016
https://dl.acm.org/doi/10.1145/2875356
Ewald RUhrmacher ADunkin AIngalls R(2009)Automating the runtime performance evaluation of simulation algorithmsWinter Simulation Conference10.5555/1995456.1995608(1079-1091)Online publication date: 13-Dec-2009
https://dl.acm.org/doi/10.5555/1995456.1995608
Show More Cited By

Abstract

References

Cited By

Index Terms

Recommendations

Experiences with the DEVStone benchmark

The DEVStone Metric: Performance Analysis of DEVS Simulation Engines

Studying performance of DEVS modeling and simulation environments using the DEVStone benchmark

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations