Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/1496950.1496973acmconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

Profiling and modeling resource usage of virtualized applications

Published: 01 December 2008 Publication History

Abstract

Next Generation Data Centers are transforming labor-intensive, hard-coded systems into shared, virtualized, automated, and fully managed adaptive infrastructures. Virtualization technologies promise great opportunities for reducing energy and hardware costs through server consolidation. However, to safely transition an application running natively on real hardware to a virtualized environment, one needs to estimate the additional resource requirements incurred by virtualization overheads.
In this work, we design a general approach for estimating the resource requirements of applications when they are transferred to a virtual environment. Our approach has two key components: a set of microbench-marks to profile the different types of virtualization overhead on a given platform, and a regression-based model that maps the native system usage profile into a virtualized one. This derived model can be used for estimating resource requirements of any application to be virtualized on a given platform. Our approach aims to eliminate error-prone manual processes and presents a fully automated solution. We illustrate the effectiveness of our methodology using Xen virtual machine monitor. Our evaluation shows that our automated model generation procedure effectively characterizes the different virtualization overheads of two diverse hardware platforms and that the models have median prediction error of less than 5% for both the RUBiS and TPC-W benchmarks.

References

[1]
Agostinelli, C.: Robust Stepwise Regression. Journal of Applied Statistics 29(6) (2002)
[2]
Ahmad, I., Anderson, J., Holler, A., Kambo, R., Makhija, V.: An Analysis of Disk Performance in VMware ESX Server Virtual Machines. In: Proc. of the Sixth Workshop on Workload Characterization (WWC 2003) (October 2003)
[3]
Amza, C., Cecchet, E., Chanda, A., Cox, A., Elnikety, S., Gil, R., Marguerite, J., Rajamani, K., Zwaenepoel, W.: Specification and implementation of dynamic Web site benchmarks. In: Proc. of WWC-5: IEEE 5th Annual Workshop on Workload Characterization (October 2002)
[4]
Apache JMeter, http://jakarta.apache.org/jmeter/
[5]
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP 2003 (2003)
[6]
Brown, A., Seltzer, M.: Operating System Benchmarking in the Wake of Lmbenc. In: Sigmetrics 1997 (1997)
[7]
Cherkasova, L., Gardner, R.: Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In: Proc. of USENIX AT (April 2005)
[8]
Draper, N. R., Smith, H.: Applied Regression Analysis. J. Wiley & Sons, Chichester (1998)
[9]
Fraser, K., Hand, S., Neugebauer, R., Pratt, I., Warfield, A., Williamson, M.: Reconstructing I/O. Technical report (2004)
[10]
Gmach, D., Rolia, J., Cherkasova, L., Kemper, A.: Capacity Management and Demand Prediction for Next Generation Data Centers. In: Proc. of the International IEEE Conference on Web Services (2007)
[11]
Gupta, D., Cherkasova, L., Gardner, R., Vahdat, A.: Enforcing Performance Isolation Across Virtual Machines in Xen. In: van Steen, M., Henning, M. (eds.) Middleware 2006. LNCS, vol. 4290, pp. 342--362. Springer, Heidelberg (2006)
[12]
Holland, P. W., Welsch, R. E.: Robust regression using iteratively reweighted least-squares. In: Communications in Statistics - Theory and Methods 6.9 (October 2007)
[13]
HP-UX Workload Manager, http://hp.com/products1/unix/operating/wlm/
[14]
HP Integrity Essentials Capacity Advisor, http://h71036.www7.hp.com/enterprise/cache/262379-0-0-0-121.html
[15]
IBM Enterprise Workload Manager, http://www.ibm.com/developerworks/autonomic/ewlm/
[16]
IBM Tivoli Performance Analyzer, http://www.ibm.com/software/tivoli/products/performance-analyzer/
[17]
King, S., Dunlap, G., Chen, P.: Operating system support for virtual machines. In: Proc. of the USENIX Annual Technical Conference, San Antonio, Texas (2003)
[18]
Liu, J., Huang, W., Abali, B., Panda, D.: High Performance VMM-Bypass I/O in Virtual Machines. In: Proc. of Usenix AT 2006 (2006)
[19]
Magenheimer, D., Christian, T.: VBlades: Optimized paravirtualization for the Itanium processor family. In: Proc. of USENIX VM Research and Technology Symposium (May 2004)
[20]
McVoy, L., Staelin, C.: lmbench: Portable tools for performance analysis. In: Proc. of the 1996 Winter USENIX, San Diego, CA (January 1996)
[21]
Menon, A., Santos, J. R., Turner, Y., Janakiraman, G. J., Zwaenepoel, W.: Diagnosing performance overheads in the Xen virtual machine environment. In: Proc. of Intl. Conf. on Virtual Execution Environments (VEE) (June 2005)
[22]
Mosberger, D., Jin, T.: Httperf---A Tool for Measuring Web Server Performance. In: Proc. of Workshop on Internet Server Performance (1998)
[23]
Padala, P., Zhu, X., Wang, Z., Singhal, S., Shin, K.: Performance Evaluation of Virtualization Technologies for Server Consolidation. HP Labs Tech. Report HPL-2007-59 (2007)
[24]
Santos, J. R., Turner, Y., Janakiraman, G. J., Pratt, I.: Bridging the Gap between Software and Hardware Techniques for I/O Virtualization. In: Proc. of Usenix (2008)
[25]
Rolia, J., Cherkasova, L., Arlitt, M., Andrzejak, A.: A Capacity Management Service for Resource Pools. In: Proc. of Intl. Workshop on Software and Performance (2005)
[26]
Seltzer, M., Krinsky, D., Smith, K., Zhang, X.: The Case for Appliction-Specific Benchmarking. In: Proc. of the 1999 Workshop on Hot Topics in Operating Systems (1999)
[27]
Seltzsam, S., Gmach, D., Krompass, S., Kemper, A.: AutoGlobe: An Automatic Administration Concept for Service-Oriented Database Applications. In: Proc. of the 22nd Intl. Conf. on Data Engineering (ICDE) (2006)
[28]
Staelin, C., McVoy, L.: mhz: Anatomy of a microbenchmark. In: Proc. of the USENIX Annual Technical Conference, New Orleans, LA (June 1998)
[29]
Sugerman, J., Venkitachalam, G., Lim, B.-H.: Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor. In: Proc. of the USENIX AT (2001)
[30]
Sysstat-7.0.4, http://perso.orange.fr/sebastien.godard/
[31]
TPC-W Benchmark, http://www.tpc.org
[32]
Urgaonkar, B., Shenoy, P., Roscoe, T.: Resource overbooking and application profiling in shared hosting platforms. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
[33]
VMmark: A Scalable Benchmark for Virtualized Systems, www.vmware.com/pdf/vmmark_intro.pdf
[34]
VMware Capacity Planner, http://www.vmware.com/products/capacity_planner/
[35]
Waldspurger, C.: Memory resource management in VMware ESX server in Operating Systems Design and Implementation. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
[36]
Wang, J., Wright, K., Gopalan, K.: XenLoop: A Transparent High Performance Inter-VM Network Loopback. In: Proc. of International Symposium on High Performance Distributed Computing (HPDC), Boston, MA (June 2008)
[37]
Whitaker, A., Shaw, M., Gribble, S.: Scale and Performance in the Denali isolation kernel. In: Proc. of Operating Systems Design and Implementation (OSDI) (December 2002)
[38]
Wood, T., Cherkasova, L., Ozonat, K., Shenoy, P.: Profiling and Modeling Resource Usage of Virtualized Applications. UMass Technical Report (September 2008)

Cited By

View all
  • (2017)Performance and Cost Considerations for Providing Geo-Elasticity in Database CloudsACM Transactions on Autonomous and Adaptive Systems10.1145/309589112:4(1-32)Online publication date: 18-Dec-2017
  • (2017)Reprint of Robust partial-load experiments with ShowstopperFuture Generation Computer Systems10.1016/j.future.2016.11.01372:C(81-104)Online publication date: 1-Jul-2017
  • (2017)Multi-Capacity Bin Packing with Dependent Items and its Application to the Packing of Brokered Workloads in Virtualized EnvironmentsFuture Generation Computer Systems10.1016/j.future.2016.08.01772:C(129-144)Online publication date: 1-Jul-2017
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
Middleware '08: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware
December 2008
448 pages
ISBN:3540898557

Sponsors

  • Adv. Comp. Sys. Assoc: Advanced Computing Systems Association
  • ACM: Association for Computing Machinery
  • IFIP: International Federation for Information Processing
  • Katholieke Universiteit Leuven: Katholieke Universiteit Leuven
  • IBBT: Interdisciplinary Institute for Broadband Technology

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2008

Check for updates

Qualifiers

  • Research-article

Conference

Middleware '08
Sponsor:
  • Adv. Comp. Sys. Assoc
  • ACM
  • IFIP
  • Katholieke Universiteit Leuven
  • IBBT

Acceptance Rates

Middleware '08 Paper Acceptance Rate 21 of 117 submissions, 18%;
Overall Acceptance Rate 203 of 948 submissions, 21%

Upcoming Conference

MIDDLEWARE '24
25th International Middleware Conference
December 2 - 6, 2024
Hong Kong , Hong Kong

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 02 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2017)Performance and Cost Considerations for Providing Geo-Elasticity in Database CloudsACM Transactions on Autonomous and Adaptive Systems10.1145/309589112:4(1-32)Online publication date: 18-Dec-2017
  • (2017)Reprint of Robust partial-load experiments with ShowstopperFuture Generation Computer Systems10.1016/j.future.2016.11.01372:C(81-104)Online publication date: 1-Jul-2017
  • (2017)Multi-Capacity Bin Packing with Dependent Items and its Application to the Packing of Brokered Workloads in Virtualized EnvironmentsFuture Generation Computer Systems10.1016/j.future.2016.08.01772:C(129-144)Online publication date: 1-Jul-2017
  • (2017)Automated QoS-oriented cloud resource optimization using containersAutomated Software Engineering10.1007/s10515-016-0191-024:1(101-137)Online publication date: 1-Mar-2017
  • (2016)Helping HPC users specify job memory requirements via machine learningProceedings of the Third International Workshop on HPC User Support Tools10.5555/3018834.3018836(6-13)Online publication date: 13-Nov-2016
  • (2016)Workload CharacterizationACM Computing Surveys10.1145/285612748:3(1-43)Online publication date: 8-Feb-2016
  • (2016)Virtualization in the Private CloudIEEE Transactions on Network and Service Management10.1109/TNSM.2016.260164613:3(608-621)Online publication date: 1-Sep-2016
  • (2016)Robust partial-load experiments with ShowstopperFuture Generation Computer Systems10.1016/j.future.2016.04.02064:C(15-38)Online publication date: 1-Nov-2016
  • (2016)A cloud brokerage approach for solving the resource management problem in multi-cloud environmentsComputers and Industrial Engineering10.1016/j.cie.2016.02.01595:C(16-26)Online publication date: 1-May-2016
  • (2015)QoS-driven probabilistic runtime evaluations of virtual machine placement on hostsProceedings of the 8th International Conference on Utility and Cloud Computing10.5555/3233397.3233412(90-94)Online publication date: 7-Dec-2015
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media