Article

lmbench: portable tools for performance analysis

Authors:

Larry McVoy,

Carl StaelinAuthors Info & Claims

ATEC '96: Proceedings of the 1996 annual conference on USENIX Annual Technical Conference

Page 23

Published: 22 January 1996 Publication History

Publisher Site

Abstract

lmbench is a micro-benchmark suite designed to focus attention on the basic building blocks of many common system applications, such as databases, simulations, software development, and networking. In almost all cases, the individual tests are the result of analysis and isolation of a customer's actual performance problem. These tools can be, and currently are, used to compare different system implementations from different vendors. In several cases, the benchmarks have uncovered previously unknown bugs and design flaws. The results have shown a strong correlation between memory system performance and overall performance. lmbench includes an extensible database of results from systems current as of late 1995.

References

[1]

{Chen94} P. M. Chen and D. A. Patterson, "A new approach to I/O performance evaluation - self-scaling I/O benchmarks, predicted I/O performance," Transactions on Computer Systems, 12 (4), pp. 308-339, November 1994.

Digital Library

Google Scholar

[2]

{Chen93} Peter M. Chen and David Patterson, "Storage performance - metrics and benchmarks," Proceedings of the IEEE, 81 (8), pp. 1151-1165, August 1993.

Crossref

Google Scholar

[3]

{Fenwick95} David M. Fenwick, Denis J. Foley, William B. Gist, Stephen R. VanDoren, and Danial Wissell, "The AlphaServer 8000 series: high-end server platform development," Digital Technical Journal, 7 (1), pp. 43-65, August 1995.

Digital Library

Google Scholar

[4]

{Hennessy96} John L. Hennessy and David A. Patterson, "Computer Architecture A Quantitative Approach, 2nd Edition," Morgan Kaufman, 1996.

Digital Library

Google Scholar

[5]

{McCalpin95} John D. McCalpin, "Memory bandwidth and machine balance in current high performance computers," IEEE Technical Committee on Computer Architecture newsletter, to appear, December 1995.

Google Scholar

[6]

{McVoy91} L. W. McVoy and S. R. Kleiman, "Extent-like Performance from a Unix File System," pp. 33-43, Proceedings USENIX Winter Conference, January 1991.

Google Scholar

[7]

{Ousterhout90} John K. Ousterhout, "Why aren't operating systems getting faster as fast as hard-ware?," pp. 247-256, Proceedings USENIX Summer Conference, June 1990.

Google Scholar

[8]

{Park90} Arvin Park and J. C. Becker, "IOStone: a synthetic file system benchmark," Computer Architecture News, 18 (2), pp. 45-52, June 1990.

Digital Library

Google Scholar

[9]

{Saavedra95} R.H. Saavedra and A.J. Smith, "Measuring cache and TLB performance and their effect on benchmark runtimes," IEEE Transactions on Computers , 44 (10), pp. 1223-1235, October 1995.

Digital Library

Google Scholar

[10]

{Stallman89} Free Software Foundation, Richard Stallman, "General Public License," 1989. Included with lmbench.

Google Scholar

[11]

{Toshiba94} Toshiba, "DRAM Components and Modules," pp. A59-A77, C37-C42, Toshiba America Electronic Components, Inc., 1994.

Google Scholar

[12]

{Wolman89} Barry L. Wolman and Thomas M. Olson, "IOBENCH: a system independent IO benchmark," Computer Architecture News, 17 (5), pp. 55-70, September 1989.

Digital Library

Google Scholar

Cited By

View all

Guo YZhang X(2024)A Comparative Analysis of Kunpeng 920 on HPC WorkloadsProceedings of the 2024 8th International Conference on High Performance Compilation, Computing and Communications10.1145/3675018.3675768(47-53)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3675018.3675768
Mao JDing HZhai JMa STsafrir DMusuvathi MGupta RAbu-Ghazaleh N(2024)Merlin: Multi-tier Optimization of eBPF Code for Performance and CompactnessProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3620666.3651387(639-653)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3620666.3651387
Koschel JBorrello PD'Elia DBos HGiuffrida CCalandrino JTroncoso C(2023)UNCONTAINEDProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620520(5055-5072)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620520
Show More Cited By

Index Terms

lmbench: portable tools for performance analysis
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering
  1. Software notations and tools
    1. Context specific languages
  2. Software organization and properties
    1. Extra-functional properties
      1. Software performance

Recommendations

Operating system benchmarking in the wake of lmbench: a case study of the performance of NetBSD on the Intel x86 architecture

The lmbench suite of operating system microbenchmarks provides a set of portable programs for use in cross-platform comparisons. We have augmented the lmbench suite to increase its flexibility and precision, and to improve its methodological and ...
Operating system benchmarking in the wake of lmbench: a case study of the performance of NetBSD on the Intel x86 architecture
SIGMETRICS '97: Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems

The lmbench suite of operating system microbenchmarks provides a set of portable programs for use in cross-platform comparisons. We have augmented the lmbench suite to increase its flexibility and precision, and to improve its methodological and ...
Mark-copy: fast copying GC with less space overhead
OOPSLA '03: Proceedings of the 18th annual ACM SIGPLAN conference on Object-oriented programing, systems, languages, and applications

Copying garbage collectors have a number of advantages over non-copying collectors, including cheap allocation and avoiding fragmentation. However, in order to provide completeness (the guarantee to reclaim each garbage object eventually), standard ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ATEC '96: Proceedings of the 1996 annual conference on USENIX Annual Technical Conference

January 1996

296 pages

Publisher

USENIX Association

United States

Publication History

Published: 22 January 1996

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

286
Total Citations
View Citations
57
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Guo YZhang X(2024)A Comparative Analysis of Kunpeng 920 on HPC WorkloadsProceedings of the 2024 8th International Conference on High Performance Compilation, Computing and Communications10.1145/3675018.3675768(47-53)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3675018.3675768
Mao JDing HZhai JMa STsafrir DMusuvathi MGupta RAbu-Ghazaleh N(2024)Merlin: Multi-tier Optimization of eBPF Code for Performance and CompactnessProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3620666.3651387(639-653)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3620666.3651387
Koschel JBorrello PD'Elia DBos HGiuffrida CCalandrino JTroncoso C(2023)UNCONTAINEDProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620520(5055-5072)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620520
Gandhi VBanerjee SAgrawal AAhmad ALee SPeinado MCalandrino JTroncoso C(2023)Rethinking system audit architectures for high event coverage and synchronous log availabilityProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620260(391-408)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620260
Jiang PHuang RLi DGuo YChen XLuan JRen YHu XCalandrino JTroncoso C(2023)Auditing frameworks need resource isolationProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620258(355-372)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620258
Du DYang BXia YChen H(2023)Accelerating Extra Dimensional Page Walks for Confidential ComputingProceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3613424.3614293(654-669)Online publication date: 28-Oct-2023
https://dl.acm.org/doi/10.1145/3613424.3614293
Tarkhani ZMadhavapeddy A(2023)Information Flow Tracking for Heterogeneous Compartmentalized SoftwareProceedings of the 26th International Symposium on Research in Attacks, Intrusions and Defenses10.1145/3607199.3607235(564-579)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3607199.3607235
Arif MAssogba KRafique MVazhkudai S(2022)Exploiting CXL-based Memory for Distributed Deep LearningProceedings of the 51st International Conference on Parallel Processing10.1145/3545008.3545054(1-11)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1145/3545008.3545054
Asifuzzaman KVerdejo RRadojković P(2022)Performance and Power Estimation of STT-MRAM Main Memory with Reliable System-level SimulationACM Transactions on Embedded Computing Systems10.1145/347683821:1(1-25)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3476838
Abidi IKumar VSen R(2021)Practical Attestation for Edge Devices Running Compute Heavy Machine Learning ApplicationsProceedings of the 37th Annual Computer Security Applications Conference10.1145/3485832.3485909(323-336)Online publication date: 6-Dec-2021
https://dl.acm.org/doi/10.1145/3485832.3485909
Show More Cited By

Cited By

Index Terms

Recommendations

Operating system benchmarking in the wake of lmbench: a case study of the performance of NetBSD on the Intel x86 architecture

Operating system benchmarking in the wake of lmbench: a case study of the performance of NetBSD on the Intel x86 architecture

Mark-copy: fast copying GC with less space overhead