research-article

Scheduling I/O in virtual machine monitors

Authors:

Scott RixnerAuthors Info & Claims

VEE '08: Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Pages 1 - 10

https://doi.org/10.1145/1346256.1346258

Published: 05 March 2008 Publication History

Abstract

This paper explores the relationship between domain scheduling in avirtual machine monitor (VMM) and I/O performance. Traditionally, VMM schedulers have focused on fairly sharing the processor resources among domains while leaving the scheduling of I/O resources as asecondary concern. However, this can resultin poor and/or unpredictable application performance, making virtualization less desirable for applications that require efficient and consistent I/O behavior.

This paper is the first to study the impact of the VMM scheduler on performance using multiple guest domains concurrently running different types of applications. In particular, different combinations of processor-intensive, bandwidth-intensive, andlatency-sensitive applications are run concurrently to quantify the impacts of different scheduler configurations on processor and I/O performance. These applications are evaluated on 11 different scheduler configurations within the Xen VMM. These configurations include a variety of scheduler extensions aimed at improving I/O performance. This cross product of scheduler configurations and application types offers insight into the key problems in VMM scheduling for I/O and motivates future innovation in this area.

References

[1]

E. Ackaouy. {Xen-devel} New CPU scheduler w/SMP load balancer. http://lists.xensource.com/archives/html/xen-devel/2006-05/msg01315.htm%l.

[2]

K. Adams and O. Agesen. A comparison of software and hardware techniques for x86 virtualization. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Oct. 2006.

Digital Library

[3]

Advanced Micro Devices. Secure Virtual Machine Architecture Reference Manual, May 2005. Revision 3.01.

[4]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the Symposium on Operating Systems Principles (SOSP), Oct. 2003.

Digital Library

[5]

L. Cherkasova and R. Gardner. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In USENIX Annual Technical Conference, Apr. 2005.

Digital Library

[6]

L. Cherkasova, D. Gupta, and A. Vahdat. When virtual is harder than real: Resource allocation challenges in virtual machine based IT environments. Technical Report HPL-2007-25, HP Laboratories Palo Alto, Feb. 2007.

[7]

S. Devine, E. Bugnion, and M. Rosenblum. Virtualization system including a virtual machine monitor for a computer with a segmented architecture. US Patent #6,397,242, Oct. 1998.

[8]

K.J. Duda and D.R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. In SOSP '99: Proceedings of the seventeenth ACM symposium on Operating systems principles, pages 261--276, New York, NY, USA, 1999. ACM Press.

Digital Library

[9]

K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Safe hardware access with the Xen virtual machine monitor. In Proceedings of the Workshop on Operating System and Architectural Support for the On Demand IT InfraStructure (OASIS), Oct. 2004.

[10]

S. Govindan, A.R. Nath, A. Das, B. Urgaonkar, and A. Sivasubramaniam. Xen and co.: communication-aware cpu scheduling for consolidated xen-based hosting platforms. In VEE '07: Proceedings of the 3rd international conference on Virtual execution environments, pages 126--136, New York, NY, USA, 2007. ACM Press.

Digital Library

[11]

D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing performance isolation across virtual machines in Xen. In Mvan Steen and MHenning, editors, Middleware, volume 4290 of Lecture Notes in Computer Science, pages 342--362. Springer, 2006.

Digital Library

[12]

Intel. Intel Virtualization Technology Specification for the Intel Itanium Architecture (VT-i), Apr. 2005. Revision 2.0.

[13]

J. Liu, W. Huang, B. Abali, and D.K. Panda. High performance VMM-bypass I/O in virtual machines. In Proceedings of the USENIX Annual Technical Conference, June 2006.

Digital Library

[14]

A. Menon, A.L. Cox, and W. Zwaenepoel. Optimizing network virtualization in Xen. In Proceedings of the USENIX Annual Technical Conference, June 2006.

Digital Library

[15]

A. Menon, J.R. Santos, Y. Turner, G.J. Janakiraman, and W. Zwaenepoel. Diagnosing performance overheads in the Xen virtual machine environment. In Proceedings of the ACM/USENIX Conference on Virtual Execution Environments, June 2005.

Digital Library

[16]

H. Raj and K. Schwan. Implementing a scalable self-virtualizing network interface on a multicore platform. In Workshop on the Interaction between Operating Systems and Computer Architecture, Oct. 2005.

[17]

H. Raj and K. Schwan. High performance and scalable i/o virtualization via self-virtualized devices. In Proceedings of the 16th International Symposium on High Performance Distributed Computing, June 2007.

Digital Library

[18]

J. Sugerman, G. Venkitachalam, and B. Lim. Virtualizing I/O devices on VMware Workstation's hosted virtual machine monitor. In Proceedings of the USENIX Annual Technical Conference, June 2001.

Digital Library

[19]

A. Whitaker, M. Shaw, and S. Gribble. Scale and performance in the Denali isolation kernel. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI), Dec. 2002.

Digital Library

[20]

P. Willmann, J. Shafer, D. Carr, A. Menon, S. Rixner, A.L. Cox, and W. Zwaenepoel. Concurrent direct network access for virtual machine monitors. In Proceedings of the 13th International Symposium on High Performance Computer Architecture, Feb. 2007.

Digital Library

Cited By

Wang LYang JZhai JYang G(2024)Optimizing I/O Performance Through Effective vCPU Scheduling Interference ManagementIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.332929835:12(2315-2330)Online publication date: Dec-2024
https://doi.org/10.1109/TPDS.2023.3329298
Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Xing TXiong CYe CWei QPicorel JBarbalace A(2023)Maximizing VMs' IO Performance on Overcommitted CPUs with FairnessProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624649(93-108)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624649
Show More Cited By

Index Terms

Scheduling I/O in virtual machine monitors
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Process management
        Scheduling

Recommendations

Task-aware virtual machine scheduling for I/O performance.
VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

The use of virtualization is progressively accommodating diverse and unpredictable workloads as being adopted in virtual desktop and cloud computing environments. Since a virtual machine monitor lacks knowledge of each virtual machine, the ...
A Technical Review for Efficient Virtual Machine Migration
CUBE '13: Proceedings of the 2013 International Conference on Cloud & Ubiquitous Computing & Emerging Technologies

This paper presents the recent technical research survey on the efficient live migration of virtual machines. Virtual machine migration is required for many reasons like load balancing, energy reduction, dynamic resizing, and to increase availability. ...
Fast Live Cloning of Virtual Machine Based on Xen
HPCC '09: Proceedings of the 2009 11th IEEE International Conference on High Performance Computing and Communications

Virtual Machine (VM) cloning is to create a replica of a source virtual machine (parent virtual machine); the replica, also called child virtual machine, owns exactly the same executing status as parent virtual machine. Fast live cloning guarantees that,...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VEE '08: Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

March 2008

190 pages

ISBN:9781595937964

DOI:10.1145/1346256

General Chair:
David Gregg
Trinity College Dublin, Ireland
,
Program Chairs:
Vikram Adve
University of Illinois at Urbana-Champaign, USA
,
Brian Bershad
Google, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VEE '08

Sponsor:

VEE '08: International Conference on Virtual Execution Environments

March 5 - 7, 2008

WA, Seattle, USA

Acceptance Rates

VEE '08 Paper Acceptance Rate 18 of 57 submissions, 32%;

Overall Acceptance Rate 80 of 235 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

259
Total Citations
View Citations
2,787
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)5

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang LYang JZhai JYang G(2024)Optimizing I/O Performance Through Effective vCPU Scheduling Interference ManagementIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.332929835:12(2315-2330)Online publication date: Dec-2024
https://doi.org/10.1109/TPDS.2023.3329298
Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Xing TXiong CYe CWei QPicorel JBarbalace A(2023)Maximizing VMs' IO Performance on Overcommitted CPUs with FairnessProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624649(93-108)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624649
Lee JLee HYu H(2022)Fine-Grained I/O Traffic Control Middleware for I/O Fairness in Virtualized SystemIEEE Access10.1109/ACCESS.2022.318773110(73122-73144)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3187731
Gong XCao DLi YLiu XLi YZhang JLi T(2021)A Thread Level SLO-Aware I/O Framework for Embedded VirtualizationIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.302604232:3(500-513)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TPDS.2020.3026042
Wang DZhang WHe HTian Y(2021)Efficient Hybrid Central Processing Unit/ Input–Output Resource Scheduling for Virtual MachinesIEEE Transactions on Industrial Electronics10.1109/TIE.2020.297546668:3(2714-2724)Online publication date: Mar-2021
https://doi.org/10.1109/TIE.2020.2975466
Jia WShan JLi TShang XCui HDing XGavrilovska AZadok E(2020)vSMT-IOProceedings of the 2020 USENIX Conference on Usenix Annual Technical Conference10.5555/3489146.3489176(449-463)Online publication date: 15-Jul-2020
https://dl.acm.org/doi/10.5555/3489146.3489176
Lee JYu H(2020)I/O Strength-Aware Credit Scheduler for Virtualized EnvironmentsElectronics10.3390/electronics91221079:12(2107)Online publication date: 10-Dec-2020
https://doi.org/10.3390/electronics9122107
Kim TPark CHuh JAhn J(2020)Reconciling Time Slice Conflicts of Virtual Machines With Dual Time Slice for CloudsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.299325231:10(2453-2465)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TPDS.2020.2993252
Yang MPeng BYao JGuan H(2020)A Throughput-Oriented NVMe Storage Virtualization with Workload-Aware ManagementIEEE Transactions on Computers10.1109/TC.2020.3037817(1-1)Online publication date: 2020
https://doi.org/10.1109/TC.2020.3037817
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten