Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/1267242.1267256guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Towards virtual networks for virtual machine grid computing

Published: 06 May 2004 Publication History

Abstract

Virtual machines can greatly simplify wide-area distributed computing by lowering the level of abstraction to the benefit of both resource providers and users. Networking, however, can be a challenge because remote sites are loath to provide connectivity to any machine attached to the site network by outsiders. In response, we have developed a simple and efficient layer two virtual network tool that in effect connects the virtual machine to the home network of the user, making the connectivity problem identical to that faced by the user when connecting any new machine to his own network. We describe this tool and evaluate its performance in LAN and WAN environments. Next, we describe our plans to enhance it to become an adaptive virtual network that will dynamically modify its topology and routing rules in response to the offered traffic load of the virtual machines it supports and to the load of the underlying network. We formalize the adaptation problem induced by this scheme and take initial steps to solving it. The virtual network will also be able to use underlying resource reservation mechanisms on behalf of virtual machines. Both adaptation and reservation will work with existing, unmodified applications and operating systems.

References

[1]
{1} ANDERSEN, D., BALAKRISHNAN, H., KAASHOEK, F., AND MORRIS, R. Resilient overlay networks. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP 2001) (2001).]]
[2]
{2} BOLLINGER, S., AND MIDKIFF, S. Heuristic techniques for processor and link assignment in multicomputers. IEEE Transactions on Computers 40, 3 (March 1991).]]
[3]
{3} CAMPBELL, A., KOUNAVIS, M., VILLELA, D., VICENTE, J., MEER, H. D., MIKI, K., AND KALAICHELVAN, K. Spawning networks. IEEE Network (July/August 1999), 16-29.]]
[4]
{4} DIKE, J. A user-mode port of the linux kernel. In Proceedings of the USENIX Annual Linux Showcase and Conference (Atlanta, GA, October 2000).]]
[5]
{5} DINDA, P., GROSS, T., KARRER, R., LOWEKAMP, B., MILLER, N., STEENKISTE, P., AND MILLER, N. The architecture of the remos system. In Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing (HPDC 2001) (August 2001), pp. 252-265.]]
[6]
{6} DINDA, P. A. Online prediction of the running time of tasks. Cluster Computing 5, 3 (2002). Earlier version appears in HPDC 2001. Summary in SIGMETRICS 2001.]]
[7]
{7} EGEVANG, K., AND FRANCIS, P. The ip network address translator (nat). Tech. Rep. RFC 1631, Internet Engineering Task Force, May 1994.]]
[8]
{8} EMBLEY, D. W., AND NAGY, G. Behavioral aspects of text editors. ACM Computing Surveys 13, 1 (January 1981), 33-70.]]
[9]
{9} ENSIM CORPORATION. http://www.ensim.com.]]
[10]
{10} FERGUSON, P., AND HUSTON, G. What is a vpn? Tech. rep., Cisco Systems, March 1998.]]
[11]
{11} FIGUEIREDO, R., DINDA, P. A., AND FORTES, J. A case for grid computing on virtual machines. In Proceedings of the 23rd IEEE Conference on Distributed Computing (ICDCS 2003 (May 2003), pp. 550-559.]]
[12]
{12} FOSTER, I., KESSELMAN, C., AND TUECKE, S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of Supercomputer Applications 15, 3 (2001).]]
[13]
{13} GARFINKEL, T., PFAFF, B., CHOW, J., ROSENBLUM, M., AND BONEH, D. Terra: A virtual machine-based platform for trusted computing. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP 2003) (October 2003).]]
[14]
{14} GLEESON, B., LIN, A., HEINANEN, J., ARMITAGE, G., AND MALIS, A. A framework for ip-based virtual private networks. Tech. Rep. RFC 2764, Internet Engineering Task-force, February 2000.]]
[15]
{15} HAND, S., HARRIS, T., KOTSOVINOS, E., AND PRATT, I. Controlling the xenoserver open platform. In Proceedings of OPENARCH 2003 (April 2003).]]
[16]
{16} HUA CHU, Y., RAO, S., SHESHAN, S., AND ZHANG, H. Enabling conferencing applications on the internet using an overlay multicast architecture. In Proceedings of ACM SIGCOMM 2001 (2001).]]
[17]
{17} IBM CORPORATION. White paper: S/390 virtual image facility for linux, guide and reference. GC24-5930-03, Feb 2001.]]
[18]
{18} IEEE 802.1Q WORKING GROUP. 802.1q: Virtual lans. Tech. rep., IEEE, 2001.]]
[19]
{19} ITALIANO, G., RASTOGI, R., AND YENER, B. Restoration algorithms for virtual private networks in the hose model. In Proceedings of IEEE INFOCOM 2002 (June 2002).]]
[20]
{20} JANNOTTI, J., GIFFORD, D., JOHNSON, K., KAASHOEK, M., AND JR., J. O. Overcast: Reliable multicasting with an overlay network. In Proceedings of OSDI 2000 (October 2000).]]
[21]
{21} JIANG, X., AND XU, D. Soda: A service-on-demand architecture for application service hosting platforms. In Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing (HPDC 2003) (June 2003), pp. 174-183.]]
[22]
{22} JIANG, X., AND XU, D. Violin: Virtual internetworking on overlay infrastructure. Tech. Rep. CSD TR 03-027, Department of Computer Sciences, Purdue University, July 2003.]]
[23]
{23} KWONG, K., AND ISHFAQ, A. Benchmarking and comparison of the task graph scheduling algorithms. Journal of Parallel and Distributed Computing 59, 3 (1999), 381-422.]]
[24]
{24} LEIGHTON, T. Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes. Morgan Kaufmann, 1992.]]
[25]
{25} MAMBRETTI, J., WEINBERGER, J., CHEN, J., BACON, E., YEH, F., LILLETHUN, D., GROSSMAN, B., GU, Y., AND MAZZUCO, M. The photonic terastream: Enabling next generation applications through intelligent optical networking at igrid2002. Future Generation Computer Systems 19, 6 (August 2003), 897-908.]]
[26]
{26} MCCANNE, S., AND JACOBSON, V. The BSD packet filter: A new architecture for user-level packet capture. In Prodeedings of USENIX 1993 (1993), pp. 259-270.]]
[27]
{27} MICROSOFT CORPORATION. Virtual server beta release.]]
[28]
{28} NICHOLS, K., BLAKE, S., BAKER, F., AND BLACK, D. Definition of the differentiated services field (ds field) in the ipv4 and ipv6 headers. Tech. rep., Internet Engineering Task Force, 1998.]]
[29]
{29} RICHARDSON, T., STAFFORD-FRASER, Q., WOOD, K. R., AND HOPPER, A. Virtual network computing. IEEE Internet Computing 2, 1 (January/February 1998).]]
[30]
{30} SAPUNTZAKIS, C., BRUMLEY, D., CHANDRA, R., ZELDOVICH, N., CHOW, J., LAM, M. S., AND ROSENBLUM, M. Virtual appliances for deploying and maintaining software. In Proceedings of the 17th Large Installation Systems Administration Conference (LISA 2003) (October 2003).]]
[31]
{31} SAPUNTZAKIS, C. P., CHANDRA, R., PFAFF, B., CHOW, J., LAM, M. S., AND ROSENBLUM:, M. Optimizing the migration of virtual computers. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI 2002) (December 2002).]]
[32]
{32} SHI, S., AND TURNER, J. Routing in Overlay Multicast Networks. In Proceedings of IEEE INFOCOM 2002 (June 2002).]]
[33]
{33} SUGERMAN, J., VENKITACHALAN, G., AND LIM, B.-H. Virtualizing I/O devices on VMware workstation's hosted virtual machine monitor. In Proceedings of the USENIX Annual Technical Conference (June 2001).]]
[34]
{34} SUNDARARAJ, A. I., AND DUCHAMP, D. Analytical characterization of the throughput of a split tcp connection. Tech. rep., Department of Computer Science, Stevens Institute of Technology, 2003.]]
[35]
{35} TOWNSLEY, W., VALENCIA, A., RUBENS, A., PALL, G., ZORN, G., AND PALTER, B. Layer two tunneling protocol "12tp". Tech. Rep. RFC 2661, Internet Engineering Task Force, August 1999.]]
[36]
{36} VIRTUOZZO CORPORATION. http://www.swsoft.com.]]
[37]
{37} VMWARE CORPORATION. http://www.vmware.com.]]
[38]
{38} WHITAKER, A., SHAW, M., AND GRIBBLE, S. Scale and performance in the denali isolation kernel. In Proceedings of the Fifth Symposium on Operating System Design and Implementation (OSDI 2002) (December 2002).]]
[39]
{39} WOLSKI, R., SPRING, N., AND HAYES, J. Predicting the CPU availability of time-shared unix systems. In Proceedings of the Eighth IEEE Symposium on High Performance Distributed Computing HPDC99 (August 1999), IEEE, pp. 105-112. Earlier version available as UCSD Technical Report Number CS98-602.]]
[40]
{40} WOLSKI, R., SPRING, N. T., AND HAYES, J. The network weather service: A distributed resource performance forecasting system. Journal of Future Generation Computing Systems (1999). To appear. A version is also available as UC-San Diego technical report number TR-CS98-599.]]

Cited By

View all
  • (2016)Self-configuring Software-defined Overlay Bypass for Seamless Inter- and Intra-cloud Virtual NetworkingProceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing10.1145/2907294.2907318(153-164)Online publication date: 31-May-2016
  • (2015)A scalable and dynamic application-level secure communication framework for inter-cloud servicesFuture Generation Computer Systems10.1016/j.future.2015.01.01848:C(19-27)Online publication date: 1-Jul-2015
  • (2014)Fast VMM-based overlay networking for bridging the cloud and high performance computingCluster Computing10.1007/s10586-013-0274-717:1(39-59)Online publication date: 1-Mar-2014
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
VM'04: Proceedings of the 3rd conference on Virtual Machine Research And Technology Symposium - Volume 3
May 2004
201 pages

Sponsors

  • USENIX Assoc: USENIX Assoc

Publisher

USENIX Association

United States

Publication History

Published: 06 May 2004

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2016)Self-configuring Software-defined Overlay Bypass for Seamless Inter- and Intra-cloud Virtual NetworkingProceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing10.1145/2907294.2907318(153-164)Online publication date: 31-May-2016
  • (2015)A scalable and dynamic application-level secure communication framework for inter-cloud servicesFuture Generation Computer Systems10.1016/j.future.2015.01.01848:C(19-27)Online publication date: 1-Jul-2015
  • (2014)Fast VMM-based overlay networking for bridging the cloud and high performance computingCluster Computing10.1007/s10586-013-0274-717:1(39-59)Online publication date: 1-Mar-2014
  • (2013)Virtual TCP offloadProceedings of the 22nd international symposium on High-performance parallel and distributed computing10.1145/2493123.2462912(49-60)Online publication date: 17-Jun-2013
  • (2013)Virtual TCP offloadProceedings of the 22nd international symposium on High-performance parallel and distributed computing10.1145/2462902.2462912(49-60)Online publication date: 17-Jun-2013
  • (2013)Experiences with self-organizing, decentralized grids using the grid applianceCluster Computing10.1007/s10586-011-0195-216:2(265-283)Online publication date: 1-Jun-2013
  • (2012)Optimizing overlay-based virtual networking through optimistic interrupts and cut-through forwardingProceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis10.5555/2388996.2389130(1-11)Online publication date: 10-Nov-2012
  • (2012)VNET/PProceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing10.1145/2287076.2287116(259-270)Online publication date: 18-Jun-2012
  • (2012)Virtual network on demandProceedings of the fifth international workshop on Data-Intensive Distributed Computing Date10.1145/2286996.2287006(53-62)Online publication date: 19-Jun-2012
  • (2011)DEVAProceedings of the 17th international conference on Parallel processing - Volume Part I10.5555/2033345.2033394(467-478)Online publication date: 29-Aug-2011
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media