Article

JouleSort: a balanced energy-efficiency benchmark

Authors:

Suzanne Rivoire,

Parthasarathy Ranganathan,

Christos KozyrakisAuthors Info & Claims

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

Pages 365 - 376

https://doi.org/10.1145/1247480.1247522

Published: 11 June 2007 Publication History

Abstract

The energy efficiency of computer systems is an important concern in a variety of contexts. In data centers, reducing energy use improves operating cost, scalability, reliability, and other factors. For mobile devices, energy consumption directly affects functionality and usability. We propose and motivate JouleSort, an external sort benchmark, for evaluating the energy efficiency of a wide range of computer systems from clusters to handhelds. We list the criteria, challenges, and pitfalls from our experience in creating a fair energy-efficiency benchmark. Using a commercial sort, we demonstrate a JouleSort system that is over 3.5x as energy-efficient as last year's estimated winner. This system is quite different from those currently used in data centers. It consists of a commodity mobile CPU and 13 laptop drives connected by server-style I/O interfaces.

References

[1]

Anonymous et al. A measure of transaction processing performance. In Datamation, pages 112--118, Apr. 1985.

[2]

L. Barroso. The price of performance. ACM Queue, 3(7), Sept. 2005.

Digital Library

[3]

P. Bose. Keynote address: Power-efficient microarchitectural choices at the early definition stage. In PACS, 2003.

[4]

D. Brooks and M. Martonosi. Dynamic thermal management for high-performance microprocessors. In HPCA, 2001.

Digital Library

[5]

C. Calwell and T. Reeder. Power supplies: A hidden opportunity for energy savings. Online, May 2002. http://www.ecosconsulting.com/resourcespublications.html#PowerSupply.

[6]

J. Chase, D. Anderson, et al. Managing energy and server resources in hosting centers. In SOSP, 2001.

Digital Library

[7]

J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI, Dec. 2004.

Digital Library

[8]

F. Douglis, P. Krishnan, and B. Marsh. Thwarting the power-hungry disk. In USENIX, 1994.

Digital Library

[9]

Embedded Microprocessor Benchmark Consortium (EEMBC). EnergyBench benchmark software. Online.http://www.eembc.org/benchmark/power\_sl.asp.

[10]

X. Fan, C. Ellis, and A. Lebeck. Memory controller policies for DRAM power management. In Low-Power Systems and Design (ISLPED), 2001.

Digital Library

[11]

W. Felter, K. Rajamani, et al. A performance-conserving approach for reducing peak power consumption in server systems. In International Conference on Supercomputing, 2005.

Digital Library

[12]

J. Flinn and M. Satyanarayanan. Energy-aware adaptation for mobile applications. In SOSP, 1999.

Digital Library

[13]

R. Gonzalez and M. Horowitz. Energy dissipation in general purpose microprocessors. IEEE Journal of Solid-State Circuits, 31(9):1277--1284, 1996.

[14]

K. Govil, E. Chen, and H. Wasserman. Comparing algorithms for dynamic speed-setting of a low-power CPU. In MobiCom, 1995.

Digital Library

[15]

N. K. Govindaraju, J. Gray, R. Kumar, and D. Manocha. GPUTeraSort: High performance graphics coprocessor sorting for large database management. In SIGMOD, June 2006.

Digital Library

[16]

J. Gray. Sort benchmark home page, Oct. 2006. http://research.microsoft.com/barc/SortBenchmark.

[17]

J. Gray, J. Coates, and C. Nyberg. Performance/Price Sort and PennySort. Technical Report MS-TR-98-45, Microsoft, Aug. 1998.

[18]

J. Gray and B. Fitzgerald. Flash disk opportunity for server-applications. Online, 2007. http://www.microsoft.com/gray.

[19]

HP enterprise configurator power calculators, Oct. 2006. http://h30099.www3.hp.com/configurator/powercalcs.asp.

[20]

C. Jones, K. Sivalingam, et al. A survey of energy-efficient network protocols for wireless networks. Wireless Networks, 7(4):354--358, July 2001.

Digital Library

[21]

J. Laudon. Performance/Watt: the new server focus. SIGARCH Computer Architecture News, 33(4):5--13, Nov. 2005.

Digital Library

[22]

M. R. Lindeburg. Mechanical Engineering Reference Manual. Professional Publications, tenth edition, 1997.

[23]

P. Lyman and H. R. Varian. How much information? Online, 2003. http://www2.sims.berkeley.edu/research/projects/how-much-info-2003/.

[24]

J. Markoff and S. Hansell. Hiding in plain sight, Google seeks an expansion of power. New York Times. June 14, 2006.

[25]

C. Nyberg, T. Barclay, Z. Cvetanovic, J. Gray, and D. Lomet. Alphasort: A cache-sensitive parallel external sort. VLDB Journal, 4(4):603--627, 1995.

Digital Library

[26]

C. Nyberg and C. Koester. Ordinal Technology-NSort Home Page. Online, 2007. http://www.ordinal.com/.

[27]

C. D. Patel. A vision of energy aware computing from chips to data centers. In Micro-Mechanical Engineering (ISMME), Dec. 2003.

[28]

C. D. Patel and P. Ranganathan. Enterprise power and cooling. ASPLOS Tutorial, Oct. 2006.

[29]

P. Pillai and K. G. Shin. Real-time dynamic voltage scaling for low-power embedded operating systems. In SOSP, pages 89--102, 2001.

Digital Library

[30]

E. Pinheiro, R. Bianchini, et al. Load balancing and unbalancing for power and performance in cluster-based systems. In Workshop on Compilers and Operating Systems for Low Power (COLP), 2001.

[31]

P. Ranganathan, E. Geelhoed, et al. Energy-aware user interfaces and energy-adaptive displays. IEEE Computer, 39(3):31--38, March 2006.

Digital Library

[32]

P. Ranganathan, P. Leech, et al. Ensemble-level power management for dense blade servers. In ISCA, 2006.

Digital Library

[33]

Standard Performance Evaluation Corporation (SPEC). SPEC power and performance committee. Online.http://www.spec.org/specpower/.

[34]

Sun Microsystems. SWaP (space, watts and performance) metric. Online. http://www.sun.com/servers/coolthreads/swap/.

[35]

United States Environmental Protection Agency (EPA). Enterprise server and data center efficiency initiatives. Online. http://www.energystar.gov/index.cfm? c=products.pr\_servers\_datacenters.

[36]

A. Weissel and F. Bellosa. Process cruise control: event-driven clock scaling for dynamic power management. In Compilers, Architecture, and Synthesis for Embedded Systems (CASES), 2002.

Digital Library

Cited By

Guo BWu JPu YZhang JYu J(2024)Energy consumption estimation and profiling for queries in distributed database systems based on a bottom-up comprehensive energy modelFuture Generation Computer Systems10.1016/j.future.2024.04.059159:C(379-394)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.future.2024.04.059
Salles RFarias R(2023)TLS Protocol Analysis Using IoTST—An IoT Benchmark Based on Scheduler TracesSensors10.3390/s2305253823:5(2538)Online publication date: 24-Feb-2023
https://doi.org/10.3390/s23052538
Sadok HPanda ASherry J(2023)Of Apples and OrangesProceedings of the 22nd ACM Workshop on Hot Topics in Networks10.1145/3626111.3628186(1-8)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3626111.3628186
Show More Cited By

Index Terms

JouleSort: a balanced energy-efficiency benchmark
1. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

SPECpower_ssj2008: driving server energy efficiency
ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

SPECpower_ssj2008 [1] is the first industry-standard SPEC [2] benchmark that evaluates the power and performance characteristics of volume server-class and multi-node class computers. This poster-paper gives an overview of the benchmark that defines the ...
TPC Express --- A New Path for TPC Benchmarks
Revised Selected Papers of the 5th TPC Technology Conference on Performance Characterization and Benchmarking - Volume 8391

To accommodate differences in systems architecture and DBMS functions and features, the TPC has long held that the best way to define a database benchmark is to author a paper specification of the application to be measured, leaving the implementation ...
SPEC: enabling efficiency measurement
ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

An overview of the SPEC PTDaemon and SPEC's Benchmark Methodology

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

June 2007

1210 pages

ISBN:9781595936868

DOI:10.1145/1247480

General Chairs:
Lizhu Zhou
Tsinghua University, China
,
Tok Wang Ling
National University of Singapore, Singapore
,
Program Chair:
Beng Chin Ooi
National University of Singapore, Singapore

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGMOD/PODS07

Sponsor:

SIGMOD/PODS07: International Conference on Management of Data

June 11 - 14, 2007

Beijing, China

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

153
Total Citations
View Citations
220
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)7

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guo BWu JPu YZhang JYu J(2024)Energy consumption estimation and profiling for queries in distributed database systems based on a bottom-up comprehensive energy modelFuture Generation Computer Systems10.1016/j.future.2024.04.059159:C(379-394)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.future.2024.04.059
Salles RFarias R(2023)TLS Protocol Analysis Using IoTST—An IoT Benchmark Based on Scheduler TracesSensors10.3390/s2305253823:5(2538)Online publication date: 24-Feb-2023
https://doi.org/10.3390/s23052538
Sadok HPanda ASherry J(2023)Of Apples and OrangesProceedings of the 22nd ACM Workshop on Hot Topics in Networks10.1145/3626111.3628186(1-8)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3626111.3628186
Guo ZZhang HZhao CBai YSwift MLiu MSchulzrinne HKohler EMaltz DMisra V(2023)LEED: A Low-Power, Fast Persistent Key-Value Store on SmartNIC JBOFsProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604880(1012-1027)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604880
Guo GQi YZhu MWang YYen J(2023)The Potential of RISC-V Platform in Financial Computing on Option Pricing and Energy Efficiency2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394561(2385-2390)Online publication date: 1-Oct-2023
https://doi.org/10.1109/SMC53992.2023.10394561
Kaur PGarg R(2023)Unravelling the Green Potential: Examining 5G’s Innovation Trends in Energy Efficiency2023 7th International Conference on Computer Applications in Electrical Engineering-Recent Advances (CERA)10.1109/CERA59325.2023.10455606(1-6)Online publication date: 27-Oct-2023
https://doi.org/10.1109/CERA59325.2023.10455606
Santry D(2023)ReferencesDemystifying Deep Learning10.1002/9781394205639.ref(229-242)Online publication date: Dec-2023
https://doi.org/10.1002/9781394205639.ref
Guo BYu JYang DLeng HLiao B(2022)Energy-Efficient Database Systems: A Systematic SurveyACM Computing Surveys10.1145/353822555:6(1-53)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3538225
Mukherjee SSarddar DBose RRoy S(2022)A Novel Cost‐Effective Secure Green Data Center Solutions Using Virtualization TechnologyCyber Security and Network Security10.1002/9781119812555.ch10(217-232)Online publication date: 27-Mar-2022
https://doi.org/10.1002/9781119812555.ch10
Bajaj S(2021)Current Drift in Energy Efficiency Cloud ComputingResearch Anthology on Architectures, Frameworks, and Integration Strategies for Distributed and Cloud Computing10.4018/978-1-7998-5339-8.ch057(1198-1214)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-5339-8.ch057
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents