research-article

Parallax: virtual disks for virtual machines

Authors:

Dutch T. Meyer,

Gitika Aggarwal,

Geoffrey Lefebvre,

Michael J. Feeley,

Norman C. Hutchinson,

Andrew WarfieldAuthors Info & Claims

Eurosys '08: Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008

Pages 41 - 54

https://doi.org/10.1145/1352592.1352598

Published: 01 April 2008 Publication History

Abstract

Parallax is a distributed storage system that uses virtualization to provide storage facilities specifically for virtual environments. The system employs a novel architecture in which storage features that have traditionally been implemented directly on high-end storage arrays and switches are relocated into a federation of storage VMs, sharing the same physical hosts as the VMs that they serve. This architecture retains the single administrative domain and OS agnosticism achieved by array- and switch-based approaches, while lowering the bar on hardware requirements and facilitating the development of new features. Parallax offers a comprehensive set of storage features including frequent, low-overhead snapshot of virtual disks, the 'gold-mastering' of template images, and the ability to use local disks as a persistent cache to dampen burst demand on networked storage.

References

[1]

M. K. Aguilera, S. Spence, and A. Veitch. Olive: distributed point-in-time branching storage for real systems. In Proceedings of the 3rd USENIX Symposium on Networked Systems Design & Implementation (NSDI 2006), pages 367--380, Berkeley, CA, USA, May 2006.

Digital Library

[2]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd USENIX Symposium on Networked Systems Design and Implementation (NSDI 2005), May 2005.

Digital Library

[3]

R. Coker. Bonnie++. http://www.coker.com.au/bonnie++.

[4]

G. W. Dunlap, S. T. King, S. Cinar, M. A. Basrai, and P. M. Chen. Revirt: Enabling intrusion analysis through virtual-machine logging and replay. In Proceedings of the 5th Symposium on Operating Systems Design & Implementation (OSDI 2002), December 2002.

Digital Library

[5]

E. Eide, L. Stoller, and J. Lepreau. An experimentation workbench for replayable networking research. In Proceedings of the Fourth USENIX Symposium on Networked Systems Design & Implementation, April 2007.

Digital Library

[6]

K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Safe hardware access with the xen virtual machine monitor. In Proceedings of the 1st Workshop on Operating System and Architectural Support for the On-Demand IT Infrastructure (OASIS-1), October 2004.

[7]

S. Frølund, A. Merchant, Y. Saito, S. Spence, and A. C. Veitch. Fab: Enterprise storage systems on a shoestring. In Proceedings of HotOS'03: 9th Workshop on Hot Topics in Operating Systems, Lihue (Kauai), Hawaii, USA, pages 169--174, May 2003.

Digital Library

[8]

C. Frost, M. Mammarella, E. Kohler, A. de los Reyes, S. Hovsepian, A. Matsuoka, and L. Zhang. Generalized file system dependencies. In Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP'07), pages 307--320, October 2007.

Digital Library

[9]

D. Hitz, J. Lau, and M. Malcolm. File system design for an NFS file server appliance. In Proceedings of the USENIX Winter 1994 Technical Conference, pages 235--246, San Fransisco, CA, USA, January 1994.

Digital Library

[10]

M. Ji. Instant snapshots in a federated array of bricks., January 2005.

[11]

J. Katcher. Postmark: a new file system benchmark, 1997.

[12]

S. T. King, G. W. Dunlap, and P. M. Chen. Debugging operating systems with time-traveling virtual machines. In ATEC '05: Proceedings of the USENIX Annual Technical Conference 2005, pages 1--15, Berkeley, CA, April 2005.

Digital Library

[13]

M. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In Proceedings of the 4th IEEE Workshop on Mobile Computing Systems and Applications, Calicoon, NY, pages 40--46, June 2002.

Digital Library

[14]

E. K. Lee and C. A. Thekkath. Petal: Distributed virtual disks. In Proceedings of the Seventh International Conference on Architectural Support for Programming Languages and Operating Systems, pages 84--92, Cambridge, MA, October 1996.

Digital Library

[15]

J. LeVasseur, V. Uhlig, J. Stoess, and S. Götz. Unmodified device driver reuse and improved system dependability via virtual machines. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation (OSDI 2004), pages 17--30, December 2004.

Digital Library

[16]

M. K. McKusick and G. R. Ganger. Soft updates: A technique for eliminating most synchronous writes in the fast filesystem. In FREENIX Track: 1999 USENIX Annual TC, pages 1--18, Monterey, CA, June 1999.

Digital Library

[17]

M. McLoughlin. The QCOW image format. http://www.gnome.org/~markmc/qcow-image-format.html.

[18]

Microsoft TechNet. Virtual hard disk image format specification. http://microsoft.com/technet/virtualserver/downloads/vhdspec.mspx.

[19]

Z. Peterson and R. Burns. Ext3cow: a time-shifting file system for regulatory compliance. ACM Transactions on Storage, 1(2):190--212, 2005.

Digital Library

[20]

B. Pfaff, T. Garfinkel, and M. Rosenblum. Virtualization aware file systems: Getting beyond the limitations of virtual disks. In Proceedings of the 3rd USENIX Symposium on Networked Systems Design & Implementation (NSDI 2006), pages 353--366, Berkeley, CA, USA, May 2006.

Digital Library

[21]

Red Hat, Inc. LVM architectural overview. http://www.redhat.com/docs/manuals/enterprise/RHEL-5-manual/Cluster_Logical_Volume_Manager/LVM_definition.html.

[22]

O. Rodeh and A. Teperman. zFS - A scalable distributed file system using object disks. In MSS '03: Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, pages 207--218, Washington, DC, USA, April 2003.

Digital Library

[23]

C. Sapuntzakis and M. Lam. Virtual appliances in the collective: A road to hassle-free computing. In Proceedings of HotOS'03: 9th Workshop on Hot Topics in Operating Systems, pages 55--60, May 2003.

Digital Library

[24]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proceedings of the 5th Symposium on Operating Systems Design & Implementation (OSDI 2002), December 2002.

Digital Library

[25]

L. Stein. Stupid file systems are better. In HOTOS'05: Proceedings of the 10th conference on Hot Topics in Operating Systems, pages 5--5, Berkeley, CA, USA, 2005.

Digital Library

[26]

VMware, Inc. Performance Tuning Best Practices for ESX Server 3. http://www.vmware.com/pdf/vi_performance_tuning.pdf.

[27]

VMWare, Inc. Using vmware esx server system and vmware virtual infrastructure for backup, restoration, and disaster recovery. www.vmware.com/pdf/esx_backup_wp.pdf.

[28]

VMWare, Inc. Virtual machine disk format. http://www.vmware.com/interfaces/vmdk.html.

[29]

VMware, Inc. VMware VMFS product datasheet. http://www.vmware.com/pdf/vmfs_datasheet.pdf.

[30]

M. Vrable, J. Ma, J. Chen, D. Moore, E. Vandekieft, A. Snoeren, G. Voelker, and S. Savage. Scalability, fidelity and containment in the Potemkin virtual honeyfarm. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP'05), pages 148--162, Brighton, UK, October 2005.

Digital Library

[31]

A. Warfield. Virtual Devices for Virtual Machines. PhD thesis, University of Cambridge, 2006.

[32]

A. Whitaker, R. S. Cox, and S. D. Gribble. Configuration debugging as search: Finding the needle in the haystack. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation (OSDI 2004), pages 77--90, December 2004.

Digital Library

Cited By

Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Li JWang QLee PShi C(2023)An In-depth Comparative Analysis of Cloud Block Storage Workloads: Findings and ImplicationsACM Transactions on Storage10.1145/357277919:2(1-32)Online publication date: 6-Mar-2023
https://dl.acm.org/doi/10.1145/3572779
Tak BTang CChang RSeo E(2021)Block-Level Storage Caching for Hypervisor-Based Cloud NodesIEEE Access10.1109/ACCESS.2021.30903089(88724-88736)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3090308
Show More Cited By

Index Terms

Parallax: virtual disks for virtual machines
1. Information systems
  1. Information storage systems
    1. Storage management
      1. Hierarchical storage management
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Parallax: virtual disks for virtual machines
EuroSys '08

Parallax is a distributed storage system that uses virtualization to provide storage facilities specifically for virtual environments. The system employs a novel architecture in which storage features that have traditionally been implemented directly on ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
Optimizing back-and-forth live migration
UCC '16: Proceedings of the 9th International Conference on Utility and Cloud Computing

Back-and-forth live migration, which means a running VM migrates between two physical machines back and forth, has several important applications. Traditional methods treat each migration as a single event, so the VM releases its system resources on the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

Eurosys '08: Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008

April 2008

346 pages

ISBN:9781605580135

DOI:10.1145/1352592

General Chair:
Joe Sventek
University of Glasgow, UK
,
Program Chair:
Steven Hand
University of Cambridge, UK

ACM SIGOPS Operating Systems Review Volume 42, Issue 4
EuroSys '08
May 2008
321 pages
ISSN:0163-5980
DOI:10.1145/1357010
Issue’s Table of Contents

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Eurosys '08

Sponsor:

Eurosys '08: Eurosys 2008 Conference

April 1 - 4, 2008

Glasgow, Scotland UK

Acceptance Rates

Overall Acceptance Rate 241 of 1,308 submissions, 18%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

86
Total Citations
View Citations
1,307
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Li JWang QLee PShi C(2023)An In-depth Comparative Analysis of Cloud Block Storage Workloads: Findings and ImplicationsACM Transactions on Storage10.1145/357277919:2(1-32)Online publication date: 6-Mar-2023
https://dl.acm.org/doi/10.1145/3572779
Tak BTang CChang RSeo E(2021)Block-Level Storage Caching for Hypervisor-Based Cloud NodesIEEE Access10.1109/ACCESS.2021.30903089(88724-88736)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3090308
Li JWang QLee PShi C(2020)An In-Depth Analysis of Cloud Block Storage Workloads in Large-Scale Production2020 IEEE International Symposium on Workload Characterization (IISWC)10.1109/IISWC50251.2020.00013(37-47)Online publication date: Oct-2020
https://doi.org/10.1109/IISWC50251.2020.00013
Fu JLu YShu JLiu GZhao M(2019)COWCache: effective flash caching for Copy-on-Write virtual disksCluster Computing10.1007/s10586-019-02948-8Online publication date: 11-Jun-2019
https://doi.org/10.1007/s10586-019-02948-8
Li WWang BSheng JHou XChen LLiu J(2018)A software defined caching framework based on user access behavior analysis for transparent computing serverPeer-to-Peer Networking and Applications10.1007/s12083-018-0699-0Online publication date: 7-Dec-2018
https://doi.org/10.1007/s12083-018-0699-0
Brengel MRossow C(2018)MemScrimper: Time- and Space-Efficient Storage of Malware Sandbox Memory DumpsDetection of Intrusions and Malware, and Vulnerability Assessment10.1007/978-3-319-93411-2_2(24-45)Online publication date: 8-Jun-2018
https://doi.org/10.1007/978-3-319-93411-2_2
Hatzieleftheriou AAnastasiadis S(2017)Client-Side Journaling for Durable Shared StorageACM Transactions on Storage10.1145/314937213:4(1-34)Online publication date: 17-Nov-2017
https://dl.acm.org/doi/10.1145/3149372
Yang CLiu XCheng X(2017)Content Look-Aside Buffer for Redundancy-Free Virtual Disk I/O and CachingACM SIGPLAN Notices10.1145/3140607.305076252:7(214-227)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3140607.3050762
Arulraj LArpaci-Dusseau AArpaci-Dusseau R(2017)Improving Virtualized Storage Performance with SkyACM SIGPLAN Notices10.1145/3140607.305075552:7(112-128)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3140607.3050755
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents